Forum Discussion
How to get stereo 360 video into Unity for VR
I’ve been looking everywhere for a solution to this problem and I’m hoping someone has a solution, or at worst, a definitive “nope, it can’t be done”.
Suppose that I have pre-rendered stereo video footage either as a T/B or SBS… is it possible to bring these assets into Unity 5+ and then create a UX that allows for the playback of different clips within VR for DK/GearVR/Cardboard/Whatever? Essentially, i’m trying to recreate something similar to the VRSE app for the GearVR. Ideally it’s an experience where the POV is like a 360 Stereo Video Skybox with a menu system to trigger other videos within the same environment.
Anyone have any advice?
Suppose that I have pre-rendered stereo video footage either as a T/B or SBS… is it possible to bring these assets into Unity 5+ and then create a UX that allows for the playback of different clips within VR for DK/GearVR/Cardboard/Whatever? Essentially, i’m trying to recreate something similar to the VRSE app for the GearVR. Ideally it’s an experience where the POV is like a 360 Stereo Video Skybox with a menu system to trigger other videos within the same environment.
Anyone have any advice?
8 Replies
- See this link
viewtopic.php?t=18185
Suggests that Unity 5.1 might do the job, might be coming out soon. Until then, I think you'd need a pricey Unity Pro plug-in from Renderheads.
Alan - The Gear VR by default supports most common file formats including 2D MP4/ AVI/FLV and 3D SBS MP4/MKV. Only audio which Android standardly supports work and that is AAC and MP3. AC3 and DTS were removed because of high licensing costs.
- Thanks everyone. I've learned a lot of other things to do with video codecs which is useful, but not what I was actually looking for. ;)
What i'm trying to find out is: How do you map the video to an environment or sphere, and how do you then map each part of the video split to match the left and right eye? - Check this out.
http://bernieroehl.com/360stereoinunity/
With MoviePlayerSample it's possible to do video but it will be low res regardless of actual video quality. - Resolution can be changed on Oculus mobile SDK 0.5 and lesser (you have to change the hardcoded resolution and recompite it though). SDK 0.6 has not released the source code, but they're planning on adding an itnerface for setting the resolution for media.
Look in Mobile SDK development part of this forum, there have been plenty of questions about how to do this. - The point is the current version does not allow changing the hardcoded resolution. It may happen in the future but when that will actually happen is an unknown. And yes, if you use an older version you can change but then you're giving up any improvements made and also potential issues of compatibility between the different versions of Unity/Oculus.
- They will soon add an interface to change the resolution, since it has been signaled as an issue during the Jam. Both the contributions I worked on used videos through Unity. Without this interface, they will have a crappy resolution... So I think oculus will act sooner than later.
