Hacker News new | ask | show | jobs
by pests 1105 days ago
The YouTube stream I watched mentioned it can detect when you are looking at your Mac and offer the screen up in the googles with full sizing and layout control. Your Mac appears just as another app and you can multitask as ususal.
3 comments

Yup -- I was a bit disappointed that it can only simulate a single monitor, but I guess since it's working wirelessly there's bandwidth limitations.

Ideally I'd love it if I could simulate a 3 monitor workstation. Maybe for the next iteration.

If you can put up all the windows from your 3 display workstation, why would you want to simulate displays?

There’s a similar approach available for the Meta quest 2 (and I’m sure the quest pro and quest 3) but it takes a little reorienting to stop thinking in terms of “screens”

Wow, this makes me think of the fabled zooming interface[0]. Why limit yourself to a "monitor" or a set of windows when the sky's (literally) the limit? With a ZUI you could have the entire world at your fingertips. Browser history (or git commits) could just be further away from you in the Z direction. Or maybe it's behind you and you just have to turn around to see it.

[0] https://en.wikipedia.org/wiki/Zooming_user_interface

An old, ancient term for it is "Spatial UI". The window you need is right where you left it in the other room; navigating between your apps becomes like navigating around your house. Your coding apps are in your office and your social media apps in your bedroom and now you won't get the two confused and "accidentally" scroll social media while working.

In some ways this is particularly great, because humans involved to have a lot of spatial memory in this way.

(It's an interesting footnote here that the early pre-OS X Mac OS Finder was sometimes much beloved [or hated, depending on your OCD predilection and/or personality type] because it was a Spatial UI. Files and folders would "stay" where you placed them and you could have and build all sorts of interesting muscle memory of where on your desktop a file was or even a deep tree of folder navigations, with scenic landmarks along the way. Apple discarded that a long time ago now, but there was something delightful in that old Spatial UI.)

Have you ever tried using https://www.switchboard.app/?
On that ZUI - have you ever tried out https://www.switchboard.app/? If so what are your thoughts? I thought it was okay.
oh hell yash

The way I mentally organize projects would make this both deeply compelling and useful,

and a total disaster lol

From what they showed, you can’t break the windows out of the screen mirror rectangle.

You’re right though, if they allowed windows to freely float, it would also solve the issue.

Check out the “Platform State of the Union” video stream for more detail on that. They discuss windows, volumes, shared space, spaces. https://developer.apple.com/wwdc23/102
I assume they would be apps running on the device, rather than on a remote machine.
Ah yes, but those apps appear to be just some kind of iOS type thing, so at least for me I couldn’t really use them for productivity. (The lack of coding tools on iOS also really kills any possible productive uses of my iPad in this way, unfortunately)

(That’s why I was focusing more on the mirror-your-Mac functionality)

We might be at a point where that could change. This device seems like it could be close to providing the performance needed to start running productivity apps, and it also provides the screen real estate. Those types of apps have to be coming to iOS in the next few years.
That doesn't make sense though. You don't need to render/composite what isn't visible.
Maybe. They told an easy to understand story in 10 seconds. Apple is amazing at educating the customer.
I don't think it can simulate any app. Likely, it is a feature akin Continuity, and you have to have corresponding app installed on your Vision Pro to pick it up from Mac and continue working on a headset.
I’m fairly certain that you can just create a virtual monitor in the vision pro that just mirrors the MacBook like any other display would.
While they did confirm Continuity would work across visionOS they also showed direct footage of your Mac monitor being displayed as an app while using your Mac.
Yeah I had missed that. It's such a neat feature!