[semi-extrinsic]

You can already spatially interact with 3D content on a regular screen. Thousands of CAD people do it all day for a living, they even have specialised peripherals for 3D navigation like the 3DConnexion stuff.