Forum Discussion
mediavr
11 years agoProtege
Stereo 360 movies from stereo 360 panoramas
Lately I have been making stereo 360 panoramas using this twin Gopro rig (and another rig with a closer interaxial).
https://www.youtube.com/watch?v=QFSeAdb9Kvs
The quality of the latest full circle fisheye M12 lenses and the good sync of the Dual Hero System and Gopro3+ Black Protune image quality and EV control at 2.7K means stereo panoramas up to 5000 by 2500 each can be captured in as little as 5 seconds. The large number of frames from video capture means slice stitching modified by manual masking stitching (PTGui's green -- "keep this" -- masking brush) can produce a seamless 360 stitch, even with quite busy scenes.
So this is a good thing in itself, but the fact that a 3d video rig is being used for the 3d panorama capture by rapid rotation means that the same rig can be used, at the top of the same pole, except not rotating, stationary, just having to be turned manually to face generally the area being videoed before the shot commences. And then afterwards, in post processing, all the frames, panorama capture frames and video insert frames are calibrated together.
Once the video frames are stabilized and aligned with the panorama frames they can be masked (to the small area of interest) and inserted seamlessly (if all has gone well) into the stereo panorama.
Here is an anaglyph version of such a composite -- https://littlstar.com/videos/3136fb91
or you can download a stereo 360 equirectangular Bottom/Top format movie for LiveViewRift etc for the Rift
http://www.dropbox.com/s/jwymmgfas3eq19r/qvbequi360BT.mp4 (17Mb).
https://www.youtube.com/watch?v=QFSeAdb9Kvs
The quality of the latest full circle fisheye M12 lenses and the good sync of the Dual Hero System and Gopro3+ Black Protune image quality and EV control at 2.7K means stereo panoramas up to 5000 by 2500 each can be captured in as little as 5 seconds. The large number of frames from video capture means slice stitching modified by manual masking stitching (PTGui's green -- "keep this" -- masking brush) can produce a seamless 360 stitch, even with quite busy scenes.
So this is a good thing in itself, but the fact that a 3d video rig is being used for the 3d panorama capture by rapid rotation means that the same rig can be used, at the top of the same pole, except not rotating, stationary, just having to be turned manually to face generally the area being videoed before the shot commences. And then afterwards, in post processing, all the frames, panorama capture frames and video insert frames are calibrated together.
Once the video frames are stabilized and aligned with the panorama frames they can be masked (to the small area of interest) and inserted seamlessly (if all has gone well) into the stereo panorama.
Here is an anaglyph version of such a composite -- https://littlstar.com/videos/3136fb91
or you can download a stereo 360 equirectangular Bottom/Top format movie for LiveViewRift etc for the Rift
http://www.dropbox.com/s/jwymmgfas3eq19r/qvbequi360BT.mp4 (17Mb).
2 Replies
- joanProtegeVery cool! You keep pushing it forward.
One type of imagery I think would be nice to visualize with this workflow is a chronophotography (also called stromotion recently), where the different parts of a motion are deconstructed and recomposited on a single background. The result is usually a still image but it summarize the entire motion and it's especially interesting for sports shots. Acrobatics, track & field, etc. I don't think it has ever been done in stereo.
What is the exact equirectangular latitude that we should set in LVR? I've set it to 95° but I'm not sure.
There is one disparity in the video, a dark grey patch behind the head of the dancer only present in the right eye. Is this coming from the panorama or the compositing?
Scrutinizing the stereo, there is also a slight amount of wobble in the pedestal and the carpet, probably coming from the compositing of the video into the background.
It's a very cool piece. - mediavrProtege> What is the exact equirectangular latitude that we should set in LVR? I've set it to 95° but I'm not sure
It is equirectangular 360/180 so the "latitude" should be 180 in LiveViewRift
>There is one disparity in the video, a dark grey patch behind the head of the dancer only present in the right eye. Is this coming from the panorama or the compositing?
Scrutinizing the stereo, there is also a slight amount of wobble in the pedestal and the carpet, probably coming from the compositing of the video into the background.>
Yes I see those thanks ... stitching the background was time consuming and I ran out of patience when I came to compositing the video in :-)
re developments of the idea -- I want to try freeze frame effects like you describe -- also a narrator character in the scene -- a real person in the real place -- it is easy to composite a skinny rectangle of video in accurately even quite close to the camera so a standing person is good for that. And I want to start adding CG elements -- titles, skies, nadir textures.
Here is a new stereo panorama -- of Sydney Opera House -- no animations this time ... yet ... it is top/bottom equirectangular 360/180
http://www.dropbox.com/s/1sfoy0p5dr4z0vp/operaoverunder.jpg
It is interesting I think how well a very large interaxial works with this - 13.5cm. The people look very small but it is easy to see the 3d form of the Opera House.
Quick Links
- Horizon Developer Support
- Quest User Forums
- Troubleshooting Forum for problems with a game or app
- Quest Support for problems with your device
Other Meta Support
Related Content
- 12 years ago