Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
Anonymous's avatar
Anonymous
10 years ago

3D Audio from video file spatialization

Hello,

I am working on a 360 video GearVR app. I'm using Movie Player Sample from Oculus sample framework. I was wondering if there is a way to assign audio from video to Unity's audio source. I am trying to make use of Oculus spatializer.

I am really not sure how to proceed with this. 

Thanks!
360 video
Audio
GearVR
Oculus Spatializer
Unity

4 Replies

Replies have been turned off for this discussion
  • vrdaveb's avatar
    vrdaveb
    Oculus Staff
    10 years ago
    On Gear VR, the Movie Player Sample uses Android's MediaSurface class, which renders the audio straight to hardware without using Unity's audio system. Unfortunately, that doesn't give the option of post-processing the audio (to my knowledge). We are considering using exoplayer for the sample, which would get around this limitation, but that could take some time. Your best bet today is probably to use EasyMovieTexture, which hands the audio back to Unity, allowing you to spatialize it to point sources or ambisonics (see TwoBigEars).
  • Anonymous's avatar
    Anonymous
    10 years ago
    Thanks for the reply. I just found about TwoBigEars today and I was thinking of using EasyMovieTexture for some time. Looks like I'm heading in the right direction. 

    Thanks for the heads up!
  • Anonymous's avatar
    Anonymous
    9 years ago
    Yes, the way I solved this was using separate video with EasyMovieTexture and separate audio (tbe format) with TwoBigEars and then syncing the audio with video (see documentation that comes with TBE Unity plguin).