Forum Discussion
AGr_
13 years agoHonored Guest
3D Streetview?
I am interested in trying to capture a static image sphere using 2 cameras in order to create a streetview like stereoscopic 3d experience, where the user wearing the Rift can pan around the image by just looking around.
Does anyone know of examples of existing implementations? My initial thoughts are that you would need a lot more data than simply 2 image spheres. So I was thinking of having 2 cameras on a head/neck model and pivot them around to take lots of images at different view angles, and then using those reference images synthesis new images for each eye depending on where exactly the user is currently looking. Can anyone suggest some reading for how best to do that image interpolation and what kind of image reprojections might be needed?
I know google streetview had an anaglyph mode for awhile, but from what I have read that was generated by combining a single image with depth data from the laser scanner, so it's not exactly the same approach.
Does anyone know of examples of existing implementations? My initial thoughts are that you would need a lot more data than simply 2 image spheres. So I was thinking of having 2 cameras on a head/neck model and pivot them around to take lots of images at different view angles, and then using those reference images synthesis new images for each eye depending on where exactly the user is currently looking. Can anyone suggest some reading for how best to do that image interpolation and what kind of image reprojections might be needed?
I know google streetview had an anaglyph mode for awhile, but from what I have read that was generated by combining a single image with depth data from the laser scanner, so it's not exactly the same approach.
18 Replies
- AGr_Honored GuestThanks for the info Bruce, for the method you described wouldnt looking to the right be a degenerate case? Where the view vector would pass through the center of both panoramas, so you wouldn't have any stereoscopic information?
This paper Panoramic Stereo Imaging System with Automatic Disparity Warping ... describes creating two panoramas, where one is just a sphere, the other is created from rotating the second camera around the first and warping/stitching the image. But there could be lots of blurring for objects near the camera' plus the rotation not reflecting the rotation of the head might make panning in the oculus odd - SSJKamuiHonored GuestI think this would be great, but Streetview is sometimes a little bit slow at reloading.
- YamHonored GuestI have studied stereo imagery quite a bit but stereo panoramas really is a niche of a niche.
Is a stitched panorama taken with narrow lens the same as one taken with a wide angle lens (would the stitched image be the same) ? if so 2 independent spherical maps is the way to go, if street view does this with an adjustable lens then job done. - BruceHonored GuestHi Brandon,
Thank you for your comments. I edited my previous posting to make it more understandable. (The left eye does not look through the right eye to see what is off in that direction! Instead, you turn your head about a point located between your two eyes, and this point is equivalent to the traditional nodal point used by panoramic photographers. I also capture an image sequence from that nodal position.)
Many thanks for that reference! At first glance I take it to be a geometric analysis of the issues raised when I suggested a proposed slit camera test to be done as a comparison to the stitched-image panorama tests I am currently shooting. I look forward to reading this reference!
I do expect objects too close to the camera to be a concern, but that's why I'm initially shooting my tests with three lens separations which approximate the distance between your eyes, and half of that distance, to the point midway between your eyes - which is also the nodal position for the camera system.
Bruce"brandonagr" wrote:
Thanks for the info Bruce, for the method you described wouldnt looking to the right be a degenerate case? Where the view vector would pass through the center of both panoramas, so you wouldn't have any stereoscopic information?
This paper Panoramic Stereo Imaging System with Automatic Disparity Warping ... describes creating two panoramas, where one is just a sphere, the other is created from rotating the second camera around the first and warping/stitching the image. But there could be lots of blurring for objects near the camera' plus the rotation not reflecting the rotation of the head might make panning in the oculus odd - AGr_Honored GuestAcquisition of stereo panoramas for display in VR environments(pdf) is also a good resource, it mentions that as long as things aren't closer than ~5 feet then the distortion from near objects being in different locations as a given camera pivots around the central point isn't a concern.
- articuliteHonored GuestHey folks,
I'm developing a social image host for single image spheres and stereo pairs. PM me to get notified when we go online.
Very excited to see other people interested in this stuff! - mediavrProtegeHi
I have been putting up some links to stereo panoramas (360*180) Ive made on the mtbs3d forum
Here is the thread
http://www.mtbs3d.com/phpBB/viewtopic.php?f=138&t=16502
Here is the link to most recent one in cubic (6 sides) stereo format (links will work for a couple more weeks)
http://www.yousendit.com/download/UVJpTG0wNXZJMHVFQk1UQw
And in spherical (equirectangular stereo)
http://www.yousendit.com/download/UVJqV0o4R3N6NEw1SE1UQw
Here is my blog on stereoscopic panoramas -- with samples, how to info etc
http://www.stereopanoramas.com/blog/
In this post there are a bunch of software links for stereo panoramas
http://www.stereopanoramas.com/blog/stereo-panorama-links/
Stereoscopic player has support for stereo stills and videos for Oculus now.
http://www.3dtv.at/Index_en.aspx
I will render some
stereoscopic movies from my stereo panoramas in what I guess will be Oculus perspective shortly.
If someone can tell me how they look I would be grateful!
PeterM - becausereasonsProtegeReally interested in taking Stereo 360/Photo-Spheres & Panoramas. Are there any easy to understand resources about capture?
Quick Links
- Horizon Developer Support
- Quest User Forums
- Troubleshooting Forum for problems with a game or app
- Quest Support for problems with your device
Other Meta Support
Related Content
- 5 months ago
- 1 year ago
- 4 years agoAnonymous