Skip to main content
Anonymous
August 24, 2016

3D Audio from video file spatialization

Hello,

I am working on a 360 video GearVR app. I'm using Movie Player Sample from Oculus sample framework. I was wondering if there is a way to assign audio from video to Unity's audio source. I am trying to make use of Oculus spatializer.

I am really not sure how to proceed with this. 

Thanks!
This topic has been closed for replies.

4 replies

vrdaveb
Inspiring
August 24, 2016
On Gear VR, the Movie Player Sample uses Android's MediaSurface class, which renders the audio straight to hardware without using Unity's audio system. Unfortunately, that doesn't give the option of post-processing the audio (to my knowledge). We are considering using exoplayer for the sample, which would get around this limitation, but that could take some time. Your best bet today is probably to use EasyMovieTexture, which hands the audio back to Unity, allowing you to spatialize it to point sources or ambisonics (see TwoBigEars).
Anonymous
August 25, 2016
Thanks for the reply. I just found about TwoBigEars today and I was thinking of using EasyMovieTexture for some time. Looks like I'm heading in the right direction. 

Thanks for the heads up!
dancingwind
New Participant
April 26, 2017
EasyMovieTexture + TwoBigEars direction is OK?
Is it succeed ?
Anonymous
April 26, 2017
Yes, the way I solved this was using separate video with EasyMovieTexture and separate audio (tbe format) with TwoBigEars and then syncing the audio with video (see documentation that comes with TBE Unity plguin).
Terms & ConditionsAccessibility statement