mardi 3 février 2015

[Q] Surround Sound in Gear VR topic






Hi all, I'm a 360° video content creator and I am looking to extend my work into using surround sound together with my 360° Atmosphaeres in the Gear VR.

I took a look at the 'Strangers' video and found the following file structure:
0L.wav
0R.wav
90L.wav
90R.wav
180L.wav
180R.wav
270L.wav
270R.wav
Have any of you seen this structure and if so, how are these signal sources positioned (i.e. is 90L/R on the right or on the left when looking down on it)? How are they recorded (I'm assuming 4 pairs of stereo mics)? I think I saw somewhere that the 3DIO mic records the above structure, however, it's too big (and expensive) to include in a 360 video rig.

Most importantly, how are the final signals processed, edited and embedded into the mp4 file so that they are positionally correct? The HE AAC MP4 codec supposedly can handle surround sound, however, how do we a) make sure that the front facing video is in line with the front facing audio? Also, how do we ensure that if someone is turning their head the audio will move together with video? I'm only guessing here but from the Felix & Paul demos it looks like they did a software implementation (maybe Unity?) that somehow runs in the Gear VR. Also, one thing I noticed with the F&P demos is that the audio does not react as quickly to changes of orientation as the video. Video is super fast, however, audio is lacking behind. So that too would point to a software/app that combines the video and audio.

If you want to get an idea of the content that I produce please search for 'Dream Beach 360'.

I would greatly appreciate your thoughts!

Eric






Aucun commentaire:

Enregistrer un commentaire