Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
AGr_'s avatar
AGr_
Honored Guest
13 years ago

3D Streetview?

I am interested in trying to capture a static image sphere using 2 cameras in order to create a streetview like stereoscopic 3d experience, where the user wearing the Rift can pan around the image by just looking around.

Does anyone know of examples of existing implementations? My initial thoughts are that you would need a lot more data than simply 2 image spheres. So I was thinking of having 2 cameras on a head/neck model and pivot them around to take lots of images at different view angles, and then using those reference images synthesis new images for each eye depending on where exactly the user is currently looking. Can anyone suggest some reading for how best to do that image interpolation and what kind of image reprojections might be needed?

I know google streetview had an anaglyph mode for awhile, but from what I have read that was generated by combining a single image with depth data from the laser scanner, so it's not exactly the same approach.

18 Replies

  • AGr_'s avatar
    AGr_
    Honored Guest
    Thanks for the info Bruce, for the method you described wouldnt looking to the right be a degenerate case? Where the view vector would pass through the center of both panoramas, so you wouldn't have any stereoscopic information?

    This paper Panoramic Stereo Imaging System with Automatic Disparity Warping ... describes creating two panoramas, where one is just a sphere, the other is created from rotating the second camera around the first and warping/stitching the image. But there could be lots of blurring for objects near the camera' plus the rotation not reflecting the rotation of the head might make panning in the oculus odd
  • I think this would be great, but Streetview is sometimes a little bit slow at reloading.
  • Yam's avatar
    Yam
    Honored Guest
    I have studied stereo imagery quite a bit but stereo panoramas really is a niche of a niche.
    Is a stitched panorama taken with narrow lens the same as one taken with a wide angle lens (would the stitched image be the same) ? if so 2 independent spherical maps is the way to go, if street view does this with an adjustable lens then job done.
  • Bruce's avatar
    Bruce
    Honored Guest
    Hi Brandon,
    Thank you for your comments. I edited my previous posting to make it more understandable. (The left eye does not look through the right eye to see what is off in that direction! Instead, you turn your head about a point located between your two eyes, and this point is equivalent to the traditional nodal point used by panoramic photographers. I also capture an image sequence from that nodal position.)

    Many thanks for that reference! At first glance I take it to be a geometric analysis of the issues raised when I suggested a proposed slit camera test to be done as a comparison to the stitched-image panorama tests I am currently shooting. I look forward to reading this reference!

    I do expect objects too close to the camera to be a concern, but that's why I'm initially shooting my tests with three lens separations which approximate the distance between your eyes, and half of that distance, to the point midway between your eyes - which is also the nodal position for the camera system.

    Bruce

    "brandonagr" wrote:
    Thanks for the info Bruce, for the method you described wouldnt looking to the right be a degenerate case? Where the view vector would pass through the center of both panoramas, so you wouldn't have any stereoscopic information?

    This paper Panoramic Stereo Imaging System with Automatic Disparity Warping ... describes creating two panoramas, where one is just a sphere, the other is created from rotating the second camera around the first and warping/stitching the image. But there could be lots of blurring for objects near the camera' plus the rotation not reflecting the rotation of the head might make panning in the oculus odd
  • Hey folks,

    I'm developing a social image host for single image spheres and stereo pairs. PM me to get notified when we go online.

    Very excited to see other people interested in this stuff!
  • Hi
    I have been putting up some links to stereo panoramas (360*180) Ive made on the mtbs3d forum
    Here is the thread
    http://www.mtbs3d.com/phpBB/viewtopic.php?f=138&t=16502

    Here is the link to most recent one in cubic (6 sides) stereo format (links will work for a couple more weeks)
    http://www.yousendit.com/download/UVJpTG0wNXZJMHVFQk1UQw
    And in spherical (equirectangular stereo)
    http://www.yousendit.com/download/UVJqV0o4R3N6NEw1SE1UQw

    Here is my blog on stereoscopic panoramas -- with samples, how to info etc
    http://www.stereopanoramas.com/blog/
    In this post there are a bunch of software links for stereo panoramas
    http://www.stereopanoramas.com/blog/stereo-panorama-links/

    Stereoscopic player has support for stereo stills and videos for Oculus now.
    http://www.3dtv.at/Index_en.aspx

    I will render some
    stereoscopic movies from my stereo panoramas in what I guess will be Oculus perspective shortly.
    If someone can tell me how they look I would be grateful!


    PeterM
  • Really interested in taking Stereo 360/Photo-Spheres & Panoramas. Are there any easy to understand resources about capture?