The challenge on 360 stereo is on the creation side. While you are able to capture decent mono 360 video with two or three cameras 360 stereo is a different beast you need at least 6-8 cameras and a lot of processing.
I think you need much more than 6-8 cameras, at least 60 - 80 cameras, so you can get a decent image for each spherical angle of a head. The challenge is to efficiently compress 60 almost identical video records.