[QRe]

First off, kudos and congrats on the launch, seems like a fun idea! I am curious, as you mentioned reverse engineering. How difficult was it to retrieve the raw gyroscope data from the AirPods - AFAIK there is no API to access this information, right?

[quitit]

If you're looking to develop based on raw or processed gyroscope data then Core Motion is helpful

https://developer.apple.com/documentation/coremotion

"For example, a game might use accelerometer and gyroscope input to control onscreen game behavior."

The part specifically about obtaining headphone orientation is here (added in 2023):

https://developer.apple.com/documentation/coremotion/cmheadp...

[anileated]

Put a sine wave emitter (or multiple) on the scene. Enable head tracking. Analyze stereo sound at the output. Mute output. There you go: you now can track user’s head without direct access to gyroscope data.

[fiq100]

Apple does not secretly analyze sine waves to infer head motion. Instead, airpods pro/max/gen-3 include actual IMUs (inertial measurement units), and ios exposes their readings through core motion.

It’s a known research technique called acoustic motion tracking (some labs use inaudible chirps to locate phones or headsets) you mentioned, but it’s not how airpods head tracking works

[graypegg]

I think they're more so talking about measuring attenuation that apple applies for the "spatial audio" effect (after apple does all of the fancy IMU tracking for you), by using a known amplitude of signal in, and the ability to programmatically monitor the signal out after the effect, you can reverse engineer a crude estimated angle out of the delta between the two.

I don't think that's how this app works though, after installing it I got a permission prompt for motion tracking.

Looks like there is an API for this. Here's an example: https://github.com/tukuyo/AirPodsPro-Motion-Sampler/blob/8ac...

[anileated]

Yup.

Since the author of the app mentioned reverse engineering, analyzing audio is a way that immediately came to mind. It should be quite precise, too, only at the expense of extra CPU cycles.

I did not imply that there is no API to get head tracking data (even though Google search overview straight up says that). It’s mostly a thought experiment. Kudos for digging up CMHeadphoneMotionManager.

[anileated]

> Apple does not secretly analyze sine waves to infer head motion.

Duh. The mechanism I described hinges on Apple being able to track head movements in the first place in order to convert that virtual 3D scene to stereo sound.

[echoangle]

Is it possible for an app to access the actual output played by the AirPods after 3D audio is applied?

[anileated]

I got an impression that you can, but I have not dug into developer reference deeply enough to cite it for sure.