[Smaug123]

I'm not, but is it yet possible to use the Vision Pro as a window manager for macOS? I'd totally get one if it were possible to lay out ordinary macOS windows in space rather than being confined to the simulation of a single rectangular screen.

[LoganDark]

I think the Steam Frame must support this once it comes out. Either first-party, or third-party. We've never had a trivially hackable, full-Linux HMD before. With known hardware like the Frame's, it should be incredibly possible to develop a VR-native Wayland compositor

[dwaite]

No , at least not yet.

On macOS, it is ultimately the app developer who is responsible for persisting and using state for windows, such as size and position. Think several terminal sessions - the terminal app needs to be the one to determine if it is representing the same 'session' as before after a restart.

If you are talking about remote display in a 3D space, the application would need to understand how to track and reopen a window in a particular location, and also there would need to be policy on how say a resize on the Vision Pro relates to the native window size once the Vision Pro is turned off.

This puts a lot of responsibility in the app developer's hands, where it is most likely not going to be accepted. So I would expect the experience to be sub-par.

There could be interesting workarounds for full-screen windows, since there are already the concepts of multiple heterogenous displays and display resolution changes on macOS. So you might have a screen, but the 'full screen' button is replaced by one which breaks the window out. The challenge would be making these persistent across connections to the Mac in a way that apps work well by default without picking up odd heuristics.

[OkGoDoIt]

Yeah this seems like an obvious thing that would make it a lot more useful. Sad that Apple is barely scratching the surface of what’s possible, and it’s too closed for third-party developers to attempt to do anything like that.

[Oreb]

At least for now, no, it is not possible. I agree that what you describe is how it ought to work in an ideal world, but it would probably require some serious rethinking of macOS UI/UX in order to make it work. For instance, it is not obvious what’s the best way to transfer the dock and the menu bar to a screen-less environment.

A hybrid solution I would love to see would be to have the current virtual screen, but with the option of dragging individual windows out of the screen.