[sanityUnbounded]

And it makes sense why it works so well. On a 2D screen, seeing data in linear rows and columns is the best option because it follows the same format we have been taught verbatim since birth. The first type of data processing a person does is learn to read. Left to right, each letter (column) represents a different sound (value), these letters build a picture, and the more of them there are the more information the story contains (debatable). Then we learn to build our own information by writing.

Then we move on to math, and we still do it with paper, almost as an extension of writing. When doing calculations in class it is natural to keep calculations and values in some type of invisible grid pattern that makes sense to the student. Then we get to the computer, and that format still follows.

Except that the first information processing a person does isn't reading at all. It's learning sounds and words, and we do that by listening and watching others do it. And the first thing we create isn't words on a page, it's likely something physical, in the form of building blocks or some other toy. This type of learning is great, but it can't be replicated well in a school system because it is expensive and doesn't scale well to the real world. If you're going to engineer and design a bridge, you're not going to start by making a bridge. So we're taught to make lines on paper that represent a bridge.

This is where (I hope) AR/VR becomes disruptive. An infinite amount of objects that can represent any piece of data on any scale in non space.

Think about how successful minecraft is. When I first played it made me realize how much creativity I had lost to pen and paper through no fault of my own. I was building logic gates without even realizing what formal logic was until I came to college.

Now make it engulf me, make it blank, and give me a wand and an in game terminal.

[intended]

I always pour water on the AR VR user input ideas - The calorific need is too high - and thinking in 3D results in an unnecessary cognitive load.

Since this thread probably has more Finance users than usual - most people have seen a bloomberg terminal. Its ugly, and filled with arcane short cuts.

Its extremely extremely good at getting its job done, and keyboard short cuts and commands are the fastest system once you gain expertise.

Keyboard short cuts and memorized lists of invocations will regularly be the fastest way of activating commands on a system for experts. Especially once it becomes muscle memmory.

For most abstract symbol manipulation, most jobs can get away with a stack of 2D pages.

If you are working in 3D, then you are doing a pretty unique set of modifications, and the average case will not apply to you.

Which is to say that AR VR will be only for a very niche set of uses.

[bonesss]

To bolster you point even further: take something like air-traffic control.

Operators are so in tuned with the incoming data that they intuitively make 3D maps in their head, while requiring 2D data for quick observation, comprehension, and real-time monitoring.

Working in a 3D space makes sense for blocking out movies, exploring physical architectures, or certain kinds of research. For everything else there universe has given us an amazing parallel processor connected to eyes that work really nicely on tabular data.

[sanityUnbounded]

I think you are right. But while I think AR/VR is good for the types of research you mentioned at first glance, I have not seen any comprehensive prototype for working with elementary mathematics in 3D space taught in schools. So I hope you are wrong, and there is room for a hands on/physical type of math.

If something comes out that can help students who struggle with math visualize those concepts in a more (to them) natural way I will be thrilled. To me these concepts were always very visual, and allowed me to pick up concepts in class by thinking that way. I only have experience in the U.S. education system, and in my experience it felt that my teachers always taught in a way that emphasized problem memorization and notation over actually understanding, mentally, the abstract concepts and problem solving. This seems like a barrier for the average student, and leaves a lot of people feeling left behind or "not smart" even though it is likely a fault in the way they are taught.

If something comes out that will allow those mental barriers to be broken, I will consider it a win.