I've considered adding a list, for sure. You don't often see layers lists for these kinds of minimal whiteboarding apps, but personally I reach for the list every time I use tldraw. :/
What kind of object rearrangement are you missing? You can move them around, resize them, rotate them, flip them, move them forward and back above and below other objects, align them to each other, distribute them apart.