Skip to main content
Participant
June 4, 2015

How to get stereo 360 video into Unity for VR

I’ve been looking everywhere for a solution to this problem and I’m hoping someone has a solution, or at worst, a definitive “nope, it can’t be done”. 

Suppose that I have pre-rendered stereo video footage either as a T/B or SBS… is it possible to bring these assets into Unity 5+ and then create a UX that allows for the playback of different clips within VR for DK/GearVR/Cardboard/Whatever? Essentially, i’m trying to recreate something similar to the VRSE app for the GearVR. Ideally it’s an experience where the POV is like a 360 Stereo Video Skybox with a menu system to trigger other videos within the same environment.

Anyone have any advice?

    8 replies

    June 4, 2015
    Current Unity/Oculus SDK has imposed some resolution limits so while it's possible the quality is less than good.
    New Participant
    June 4, 2015
    See this link

    viewtopic.php?t=18185

    Suggests that Unity 5.1 might do the job, might be coming out soon. Until then, I think you'd need a pricey Unity Pro plug-in from Renderheads.

    Alan
    Participant
    June 5, 2015
    The Gear VR by default supports most common file formats including 2D MP4/ AVI/FLV and 3D SBS MP4/MKV. Only audio which Android standardly supports work and that is AAC and MP3. AC3 and DTS were removed because of high licensing costs.
    hiredgoonAuthor
    Participant
    June 6, 2015
    Thanks everyone. I've learned a lot of other things to do with video codecs which is useful, but not what I was actually looking for. ;)

    What i'm trying to find out is: How do you map the video to an environment or sphere, and how do you then map each part of the video split to match the left and right eye?
    June 6, 2015
    Check this out.
    http://bernieroehl.com/360stereoinunity/

    With MoviePlayerSample it's possible to do video but it will be low res regardless of actual video quality.
    Up and Coming
    June 9, 2015
    Resolution can be changed on Oculus mobile SDK 0.5 and lesser (you have to change the hardcoded resolution and recompite it though). SDK 0.6 has not released the source code, but they're planning on adding an itnerface for setting the resolution for media.

    Look in Mobile SDK development part of this forum, there have been plenty of questions about how to do this.
    June 9, 2015
    The point is the current version does not allow changing the hardcoded resolution. It may happen in the future but when that will actually happen is an unknown. And yes, if you use an older version you can change but then you're giving up any improvements made and also potential issues of compatibility between the different versions of Unity/Oculus.
    Up and Coming
    June 9, 2015
    They will soon add an interface to change the resolution, since it has been signaled as an issue during the Jam. Both the contributions I worked on used videos through Unity. Without this interface, they will have a crappy resolution... So I think oculus will act sooner than later.