Keeping bearing constant without cropping with 3d movies

Short answer - track the movie and re-render it into a 360 panoramic format. Consider this movie (in cross-eyed side by side equirectangular format). https://www.youtube.com/watch?v=3JXi175-W...