Forum Discussion
Dirrogate
12 years agoExpert Protege
Map Stereoscopic (left/right) Pano images for OVRcameras?
Hi,
I've asked on Reddit, but thought I'd also ask here,
I was wondering what the methodology would be...assuming i had a stereoscopic Equirectangular or Cubic Panorama image as backgrounds for the Oculus CameraController in Unity.
To elaborate: I'd like to create a unity scene where Unity game object (say a simple Cube) was placed in a scene that has a stereoscopic Panorama as the background (a la skybox effect)
In essence, this would entail the left pano image being mapped to the inside of a sphere, seen only by the "Left OvrCamera" while the right image is wrapped to a sphere seen only by the "Right OVRcamera"
...meanwhile, the foreground object (the cube) is placed normally and seen via the OvrCamera, overall.
Any ideas? how to accomplish this? I'm guessing some scripting wizardry might be needed so that the Left Ovrcam sees only the left background pano image and vice versa.
I'm no coding expert at all, so would appreciate any insights.
Kind Regards.
I've asked on Reddit, but thought I'd also ask here,
I was wondering what the methodology would be...assuming i had a stereoscopic Equirectangular or Cubic Panorama image as backgrounds for the Oculus CameraController in Unity.
To elaborate: I'd like to create a unity scene where Unity game object (say a simple Cube) was placed in a scene that has a stereoscopic Panorama as the background (a la skybox effect)
In essence, this would entail the left pano image being mapped to the inside of a sphere, seen only by the "Left OvrCamera" while the right image is wrapped to a sphere seen only by the "Right OVRcamera"
...meanwhile, the foreground object (the cube) is placed normally and seen via the OvrCamera, overall.
Any ideas? how to accomplish this? I'm guessing some scripting wizardry might be needed so that the Left Ovrcam sees only the left background pano image and vice versa.
I'm no coding expert at all, so would appreciate any insights.
Kind Regards.
13 Replies
- DirrogateExpert ProtegeMediaVR has two example Equirectangular pano images posted on this thread:
http://www.mtbs3d.com/phpBB/viewtopic.php?f=138&t=16502
Direct links to download:
http://www.mediavr.com/belmorepark1left.jpg
http://www.mediavr.com/belmorepark1right.jpg - DirrogateExpert ProtegeBaseDeltaZero, on Reddit answered:
>> 1) You need 2 spheres one with the left panorama the other with the right panorama applied.
2) Make 2 new layers, left and right.
3) Set the left panorama only to the left layer and right pano only to the right layer
4) in the left OVRCamera set the culling mask to left and right to the right camera.
That should do it ;)
--------------
I'm a Unity noob, trying to do way too much, so I didn't even think of this.
Will try it later this evening, but the logic sounds solid enough!
Kind Regards. - j1vvyHonored Gueststereo panoramic images are really meant to be viewed from one spot.
How far away is this background? Too far away and there would not be any depth anyway so you can stick to 2D.
If objects in this background are close then moving around these objects need to shift in perspective too.
You might be able to build up the pano in layers so each eye would see slightly different perspective.
The other option is to use depthmap so so an image is generated for each eye with the right perspective. - DirrogateExpert ProtegeThanks j1vvy,
All good points!
>>How far away is this background? Too far away and there would not be any depth anyway so you can stick to 2D.
I'll copy below some more info in reply to a similar question on the reddit post.
---- c paste ---
shooting stereo panos for this particular project would be:
1) for scenes where there is control of the environment, two shots (left/right) done with a parabolic mirror, or a conventional gopro 360 rig, shot in cha-cha method.
2) Where there's no control of the environ, Two pairs of stereocameras with wide angle lenses giving a wide HFOV. This will then be stitched to a second shot of the background (other part of the hemisphere) with the two pairs of stereocams rotated, and because there's no way to guarantee the two shots will be in sync, the "back" hemisphere will be "bokeh"-ed out, thereby suggesting to the rift wearer, where he/she should be looking.
3) For yet other scenes, it will be a conventional 2D pano shot, then converted to Cubic map...then a 2D to 3D pass done to give 'depth' to elements in the scene... think pedestrians on one plane, vehicles and trees on another, and far background on another...
I can do this, only because this is a motion comic, and not a full fledged action movie.
Yet, you might want to check what JauntVR are doing with their 14 camera GoPro rig. I've written about them (and so have others). Here: http://realvision.ae/blog/2014/08/the-language-of-visual-storytelling-in-360-virtual-reality/
---- end paste ---
Kind Regards. - j1vvyHonored GuestYes, I am familiar with JauntVR. They are capturing the entire sphere with at least 3 cameras at each point. This allows them to calculate the actual 3D data and reconstruct the scene as 3D.
Before I heard of JauntVR I created my own 360° Stereoscopic 3D Panoramic Video Rig. http://photocreations.ca/3D/mobius_camera_rig.html
Using jut a pair of images will not cover the entire sphere.
Using two parabolic mirror will not give stereoscopic in any but the forward direction and behind will be backwards.
Capturing S3D panoramas is several degrees harder than capturing 2D panoramas and doing it in video is harder still.
Because on the motion comic I would do the layer effect using masked panos on top of each other. The panos would be 2D but you can provide 3D by adjusting what each eye sees. - DirrogateExpert Protege>> Using jut a pair of images will not cover the entire sphere.
I know :) It won't be just a pair of images from a single side-by-side rig. IT will be *two* sBs rigs, with wide angle lenses covering a wider field of view...and that's why I say the rear "hemisphere" will be bokeh-ed out in post. (the option 2 i'd mentioned)
>> Using two parabolic mirror will not give stereoscopic in any but the forward direction and behind will be backwards.
It will... and it will be a single parabolic mirror, that's why I said "cha cha" ;) But and this is an important but... You need total control of the environment between takes. i.e mostly for an indoor shot.
Using two parabolic mirrors will make the interaxial of the 3D rig way to large.
>>Capturing S3D panoramas is several degrees harder than capturing 2D panoramas and doing it in video is harder still.
Yup your right!
Kind Regards,
Clyde.
(author: Think in 3D - http://www.amazon.com/Think-3D-Clyde-Dsouza-ebook/dp/B007DK92J0 ) - DirrogateExpert ProtegeSaw the pic of your rig. Impressive work.
I was going to ask how they were synced, then I read the last line on the page.
The only other thing is the issue of toe-in on the pairs. I'm assuming a lot of keystone post correction was done on final images?
That is an impressive DIY rig though. I'm going to have to build a multicam rig for 360 spherical video for my next project, but it will have to have scanline level sync (if Cmos) No matter what people say about GoPro sync, I'm not convinced until I confirm it myself. Especially 7 pairs of Gopros together.
Regards. - j1vvyHonored GuestBesides my rig, you could use this rig with 12 GoPro cameras described by EleVR http://elevr.com/tutorial-3d-spherical-camera-head/
There is a cable to sync 2 GoPro for stereo work. and if the 6 pairs in this rig were synced it would solve half your problems but currently there is no method to sync more than two GoPros.
Here is another solution that can cover 180° straight up or down.
http://www.iximage.com/
Before the end of the year I expect some other simpler solutions for shooting S3D panoramic video.
This might explain the problem of trying to create spherical S3D panos from only two points of view as you describe with the parabolic mirror.
viewtopic.php?f=33&t=4613&start=20#p87098
I have only started shooting in stereo 9 months ago, but I have been shooting panoramas and stitching panos together since 1992.
You should also join the conversation here.
viewtopic.php?f=26&t=10623 - DirrogateExpert Protege

A quick 'n dirty animgif I threw together...
That's my idea of a parabolic mirror. This is a Two-shot (need an absolutely controlled environment) cha-cha panorama. This is only for still panoramas, it won't work for video panos for obvious reasons.
For the purpose of the motion comic project however - should be fine.
I actually owned such a parabolic lens donated by Remote Reality, back in 1999. Yeah it's lost now, so will need to buy one from 0-360 or another manufacturer.
The entire 'view' is captured in one shot for left and then right eye. The parallax between shots in this case is needed. So it's not the same as the stereo rig anim (parallax rot error when stitching) link you posted.
Thanks for the interesting discussion link, I'll read through today and join in the conversation.
Kind Regards. - j1vvyHonored GuestI understood what you meant by the Cha-Cha shooting method.
People thinking they can use use two parabolic lens, is a common misconception. But the results will not be what you want.
In front of the camera will be captured from two distinct locations and give S3D. But the sides will have no S3D.
imagine rotating the diagram 90° so you are beside, now the cameras are moving toward and away from you and not the required left and right.
The same thing happens when capturing extreme wide angle fisheye lenses in stereo. There will be stereo separation in front of the camera but the separation will diminish to nothing as the lenses become one behind the other as you capture the sides. But you have stated you will only show 2D behind anyway so no big deal.
For the parabolic mirror when rotating all the way around and looking behind the cameras are now switched, on the wrong side.
Just use the parabolic mirror to capture 2D.
Quick Links
- Horizon Developer Support
- Quest User Forums
- Troubleshooting Forum for problems with a game or app
- Quest Support for problems with your device
Other Meta Support
Related Content
- 6 months ago