It's been fun. It's not too dissimilar to iOS - a lot of spatial capabilities are linked very closely with RealityKit, it's worth looking at the API if you're interested. I was thinking we'd use Metal for rendering, but as I think there are privacy issues with accessing the raw camera data, it's only supported for 'full' spaces, so not the mixed / camera feed + overlay.
It's been fun. It's not too dissimilar to iOS - a lot of spatial capabilities are linked very closely with RealityKit, it's worth looking at the API if you're interested. I was thinking we'd use Metal for rendering, but as I think there are privacy issues with accessing the raw camera data, it's only supported for 'full' spaces, so not the mixed / camera feed + overlay.