Being John Malkovich View Mode aka Moveable Viewscreen

I posted this on Reddit here on the idea of orientation data from either a camera that took the video or from the Rift that was used to record a Let's Play video. That orientation data is then used to shift the screen viewing the video in VR.

This creates a pseudo-stabilized view of the video where the rotation of the camera or player's head will not disorient the viewer. The viewer instead will see the screen is moving to the right, so the viewer just looks right to keep up with the action. I've tested this using image stabilized gifs and the result is pleasant to watch in VR. What it looks like is a smaller video projected onto a larger dome or spherical screen then that video is moved around the screen.

Wasn't sure the best term for a viewmode like this. Flashlight or Headlight view makes since it would seem as if the view is projected from your center. Being John Malkovich viewmode could also work as a term even though the movie is more like watch replays of VR games on YouTube (screen stuck to face).

Benefits if this idea is expanded:

Video demos of games feel more like being in the game. You get to keep the S3D of the game without the disorientation that comes about having the let's player moving his head around.

Televised Sports games can have smaller FOV videos. What's better is they can include persistent view mode where the screen will keep older view if the active screen is not in that position. This allows an entire football field to be in view even if 90 degrees of the view is actual live video.

Difficulties:

Syncing the orientation to the video. This seems like the biggest hurdle.

Positional movement in the video cannot be compensated. Yeah, would could play the game of chase the viewscreen, but I don't know how far that would fly. Best to just not account for it.

Positional tracking on the DK2 and later will make people leaning over look weird for people watching a replay.