Skip to main content
New Participant
June 15, 2013
Question

Idea Inspirations from trying the Oculus Rift

I got to try the Oculus Rift for the first time this week at a local IGDA meeting in Minneapolis. I wrote about my first experience and first impressions on my blog, but the experience was also very inspiring creatively.

Obviously there are going to be many first-person games, in particular FPS games, for the Rift. But I think there's a lot of potential for other applications, and that's what excites me more. Think of being an eye floating above a 3d abstract puzzle game, whose environment you are a part of. Think of playing a 3d sidescrolling platformer, but instead of playing it on your TV, it is like you've moved inside of the screen and you now occupy the same space as the characters you control. You could watch a 3 inch tall Mario walking, running, and jumping his way through a model-sized game level laid out in front of you.

Imagine yourself a few years in the future when the Rift has a resolution beyond the "Retina" display densities of today. Let's say resolution of the Rift has reached maybe double that of your current laptop screen. Now sit down, put that laptop in your lap, and then put on your Oculus Rift. Your laptop is outputting its display in realtime into the Rift's simulation where there is a virtual laptop displaying your screen's contents. Your arms are being tracked, so you can even look down and hunt for the home row keys if you need to. Now you can program a game, write a grad school paper, or code up a web page inside of the simulation. You are no longer sitting at a desk in a cubicle. You aren't sitting on the same boring couch in your living room. You can be anywhere. You can laptop on a beach. You can laptop on the moon. Bottom of the sea. Whatever. Indulgent? Bit creepy? Only because it is actually going to be possible. And soon. And at tablet prices.

Let me walk you through another imaginary experience with an Oculus Rift. One that wouldn't necessarily have to wait for some future super high resolution iteration. Ok, grab a real SNES gamepad, and now put on your Oculus Rift. You've just entered a 3d simulation of your living room. And there's your TV in front of you, a virtual 2d display embedded in the 3d simulated environment. Pop your Zelda: A Link to the Past cartridge into your Super Nintendo. You are playing Zelda and controlling Link with the gamepad, but you are watching it on a virtual TV instead of a real TV. You enter the Lost Woods. The graphics on the screen are those familiar tiled-based green trees with that pixel fog you loved so much as a kid. But something is happening now that has never happened before. The drywall disappears and trees move in. Grass grows over the couch you were sitting on and also the floor beneath your feet. A fog fills the room. You are sitting in a 3d Lost Woods now that surrounds you. Your TV set sits on top of a hollow log, and you are still playing Zelda: A Link to the Past for SNES.

I think that'd be pretty damn cool.

    33 replies

    Up and Coming
    July 4, 2013
    I am looking forward to interfacing VR with stereo video telepresence. Because of the goggles it would be weird for 2-way communication unless you're in a virtual forum. But what I really want is to pilot a robot drone avatar body to play with real animals. And hope for NASA to set up stereo camera feeds across the solar system we can jack into, including satellites in close orbit around Jupiter and Saturn. Space tourism from your own couch.
    Up and Coming
    July 4, 2013
    This thread reminded me of that "World Builder" short film from a few years ago, which depicted a gesture-operated virtual CAD immersion environment. That technology is within reach of anyone with the dedication and spatial reasoning to will it. Not just for scene construction, but for engineering design, and more abstract forms of composition. Imagine projecting abstract constructs into an engageable Euclidean 3D space.
    Example: Music. I've always wanted to compose, but have never felt fully comfortable with the tools at my disposal. But now we can have feedback utilities and instruments that were never possible before.
    You can have holographic displays that feed back real-time harmonographs, enhanced spectrograms, and cymatic sand plate simulations to help you visualize the music. You could configure a color to each note, and the room transforms to the flow of the sound. Maybe seeing the sound from a new perspective enables you to see what you want to change, so you reshape sound components with your hands as you listen.
    You can have a virtual theremin that lets you actually see the electromagnetic field contours, or regions of space that correlate to sound frequencies.
    Up and Coming
    July 6, 2013
    I really just want GoPro to push a double-camera-capture option so that I can be Jeb Corliss, Grinding the Crack http://www.youtube.com/watch?v=TWfph3iNC-k
    Or that Red Bull sponsored guy who dropped from the edge of space...

    Or maybe Brock Lesnar chasing puny mma fighters around the ring...

    But I also like the telepresence idea. I would jump into a Roomba fitted with a GoPro for a class in California on A.I. and then 30 minutes later connect to a Beach Umbrella in Brazil to see the waves before jumping to the outside of the ISS to watch the Earth eclipse the sun.
    Up and Coming
    August 8, 2013
    "bitskipper" wrote:


    well, I haven't gotten as far as that yet but it's a start!

    download link(windows):
    https://www.dropbox.com/s/mjiunx4lco0mjzv/snes9x%20VRcade.zip


    Thanks soo much for doing this, I hope there might be some possible updates?
    Hands and arms moving?
    I also hope someone does this for other consoles too.

    Anyway, snes9x VRcade is great, all the fun of the old console, but for some reason, cooler :-)
    I want to play all my favorites on that now.
    I've posted on http://virtualreality.com.au/2013/08/08/demo-snes9x-vrcade/


    Our Website: http://www.virtualreality.com.au Our Youtube Channel : http://www.youtube.com/user/virtualrealityau
    Participant
    August 8, 2013
    But what happens if you put on an Oculus Rift while you're in the simulation ...? I think we need to go deeper :ugeek:

    One cool demo I saw was a hand-held stereo camera with binaural audio recording possibility which recorded "reality videos". Watching the recording on a Rift + headphones, it was almost like being there.
    Up and Coming
    August 15, 2013
    Image you put on the Rift and headphones and immediately you are in the center of a large stadium as your favorite rockstar or celebrity with 100,000 screaming fans looking at you and watching your every move.

    The lighting, stage and 3D depth add to the realism. Your entire 360 degree FOV are your virtual fans looking directly at you. The entire 360 degree stadium is packed. With the High Def, great sound and the 3D experience, anyone can feel like a Rockstar! You can even add smoke/light effects to be able to render more people.

    Put yourself in center stage in the ultimate Rift Rockstar Experience!

    Can even add a Guitar Hero to it. You hold an actual guitar and you look down in the rift and see your rendered hands holding a guitar. Off in the distance you see a large screen, on it, the guitar hero game with the buttons you have to hit! And there are 4 screens total in the distance, so that you can turn around and still play!
    Up and Coming
    August 16, 2013
    A virtual stage would be a cool platform for virtual jam sessions, as long as there is near-zero latency. You could rig a system where you plug in an electric guitar, run it through physical and virtual effect filters, and have the sound play only through your headphones, and for the other participants. So you can have "loud" jams without waking up the neighborhood.

    I'm actually imagining the option to be a spectator, and having a massive online community tune into your performance to yell out "I play better than that while humping your mom" type insults. The whole self-affirmation aspect of it reminds me of the cheesy "Cheers to You" tapes. But actually this could be an interesting venue for real performers. No having to book hotels or flights, or stadium sound checks. The concert experience, customized from your couch. 8-)

    What I've been imagining is a virtual recording suite (or stage) where in you are surrounded by a real-time multi-color 3D visualization of your music. The possibilities of the visualization would be endless, but it could be used to let you 'see' the scales and tensions, and harmonics as you create them. You could even use a dynamic AI to predictively suggest the next chord change, or to generate an accompaniment track in any instrument. You can play along with robot musicians, and when the AI is good enough, a virtual Jimi Hendrix, or a freestyling Tupac.
    Participant
    August 18, 2013
    Imagine being able to sit in the best seat of your fav sporting stadium, and see all the fans that are actually there.Feel the atmosphere! And watch the game front and centre, live! At a cost no doubt. Or even better being your fav player as they have a Go Pro like device integrated into their jersey or helmet.. You could be your fav player not in a fake game but the actual sport in real time. So Mind buffering....
    New Participant
    October 11, 2013
    Somebody has taken the playing-a-game-on-a-TV-inside-the-Rift game idea and made something that looks AMAZING!




    Terrifying horror meta game! Yes!
    zachstronaut.com
    Up and Coming
    November 22, 2013
    Question. How do you get the input of the Snes9X emulator to accept keyboard keys as input? I played around with the settings and put in the keyboard keys as inputs and enabled that joystick, but it has no response on the screen.