[mcrider]

I've been following Dynamicland since its inception, and the work is really cool. But it seems like all of the interface work is rather two-dimensional (i.e. using paper). Isn't the underlying theory that this is all based on that humans are better suited at working with three-dimensional objects (like doorknobs and cutlery and what not)?

I think it would be really cool if the Dynamicland UI technology (projection and object recognition) could work with e.g. 3d printed objects, especially if they could be embedded with motion tracking sensors in the case that your hand occludes the computer vision trackers. Is anyone working on that sort of thing?

[seanmcdirmid]

Sounds like something that you would see a lot of at SIGGRAPH, but all I can find is https://www.youtube.com/watch?v=QHSDGBGct9g, https://www.youtube.com/watch?v=oauJ99Mfru4, https://www.youtube.com/watch?v=ogsCTxAxGwU.

I know hololens can do some of that, but not to a terribly great extent (better at just bringing virtual 3D objects into your environment).

[goliatone]

To some extent there is the reactable, which is geared towards making music. I would imagine an extension of the idea could go in the direction you picture. Note that the reactable is tied to the surface to capture some of its interactions

http://reactable.com

[Guthur]

I would disagree. We live in a 3d world but more often than not we communicate complex concepts for understanding in 2d; writing and drawings