Forum Discussion
Oculus VR with motion capture
{update20140809}
hi guys, we put it on Kickstarter.We worked really hard to make it affordable and easy to use. Now you guys are able to get this kind of stuff home and play with it. We are exhibiting a few days later at Siggragh 2014, booth 533.
Back us :)
https://www.kickstarter.com/projects/1663270989/project-perception-neuron?ref=discovery
{update20131025}
1st Rift/trueMotion MoCap/FPS demo
[updata20130829]
Successfully combined our motion capture system with Oculus Rift.
Now you can walk and run in the virtual world, and you can touch things by using your own hands like this!
Oculus with trueMotion2.jpg
Oculus with trueMotion.jpg
some recent update on VR with motion capture to share here (20130714)
It's in Chinese but I believe you'll understand what I mean
3 screens from left to right
1, from your goggle, 2. 3rd party view, 3. real-time captured video
http://youtu.be/EGZ5Y5x95P4
and... we are flying to Anaheim, California for Siggragh 2013 exhibition next weekend and the week following. Come and check us out!
http://youtu.be/R6pnPggN0Tk
Hi guys,
Here is a motion capture system developed by my team using IMUs (demo videos list below).
0. Peking opera realtime captured
http://www.youtube.com/watch?v=Gul7LWna3KI
1. Fullbody motion capture
http://youtu.be/DPGEG8U7Be8
2. Lowerbody motion capture
http://youtu.be/QgyY3aRtiwk
Those are real-time captured by using match-box-sized wireless IMU sensors.
I'm considering whether it is possible to combine our system with Oculus Rift which will make an idea virtual reality environment.
I’ll start to make Oculus Rift work with my motion capture system as soon as I get the dev kit. For a full body motion capture we need 17 sensors but my thought is that lower body tracking (7 sensors) is good enough for this. Maybe one more for chest?
Although my motion capture system is fully wireless, I think I still need something mobile to feed the video to Oculus Rift. Does anyone know how to transfer DVI video wirelessly? I really don’t wanna carry a 5 pound IBM laptop while running around in my office.
hi guys, we put it on Kickstarter.We worked really hard to make it affordable and easy to use. Now you guys are able to get this kind of stuff home and play with it. We are exhibiting a few days later at Siggragh 2014, booth 533.
Back us :)
https://www.kickstarter.com/projects/1663270989/project-perception-neuron?ref=discovery
{update20131025}
1st Rift/trueMotion MoCap/FPS demo
[updata20130829]
Successfully combined our motion capture system with Oculus Rift.
Now you can walk and run in the virtual world, and you can touch things by using your own hands like this!
Oculus with trueMotion2.jpg
Oculus with trueMotion.jpg
some recent update on VR with motion capture to share here (20130714)
It's in Chinese but I believe you'll understand what I mean
3 screens from left to right
1, from your goggle, 2. 3rd party view, 3. real-time captured video
http://youtu.be/EGZ5Y5x95P4
and... we are flying to Anaheim, California for Siggragh 2013 exhibition next weekend and the week following. Come and check us out!
http://youtu.be/R6pnPggN0Tk
Hi guys,
Here is a motion capture system developed by my team using IMUs (demo videos list below).
0. Peking opera realtime captured
http://www.youtube.com/watch?v=Gul7LWna3KI
1. Fullbody motion capture
http://youtu.be/DPGEG8U7Be8
2. Lowerbody motion capture
http://youtu.be/QgyY3aRtiwk
Those are real-time captured by using match-box-sized wireless IMU sensors.
I'm considering whether it is possible to combine our system with Oculus Rift which will make an idea virtual reality environment.
I’ll start to make Oculus Rift work with my motion capture system as soon as I get the dev kit. For a full body motion capture we need 17 sensors but my thought is that lower body tracking (7 sensors) is good enough for this. Maybe one more for chest?
Although my motion capture system is fully wireless, I think I still need something mobile to feed the video to Oculus Rift. Does anyone know how to transfer DVI video wirelessly? I really don’t wanna carry a 5 pound IBM laptop while running around in my office.
28 Replies
"rldai" wrote:
... Does anyone know how to transfer DVI video wirelessly? I really don’t wanna carry a 5 pound IBM laptop while running around in my office.
If you do not mind using clearance-priced new items, you can get LG wireless HDMI transmitter and receiver for about $30 (list price $350):
http://www.mtbs3d.com/phpBB/viewtopic.php?f=140&t=16947&p=118380#p118380
I have five of these, and they work quite well (about 30 feet, through a wall and bookcases). They also have a return channel for remote-control signals.
The Rift DK already comes with a DVI-to-HDMI adapter that you can use with this.- Hey this is exactly what I'm looking for. Thanks man!
Does it reduce frame rate according to your experience?? I'm planning to transfer 60 fps video through it if possible. "rldai" wrote:
Hey this is exactly what I'm looking for. Thanks man!
Does it reduce frame rate according to your experience?? I'm planning to transfer 60 fps video through it if possible.
They are reported to have almost zero latency. I believe that these units only support up to 60Hz framerate, with SBS 3D. You *might* be able to push them to 75Hz (still within Rift LCD specifications).
You still need to get your head tracker data back to the host PC. There was speculation that the return channel on these *might* support that (perhaps filtered to a lower data rate by something like an Arduino or Raspberry Pi). It would be easier to use wireless USB for the return channel, but a lot of those (WUSB) products are no longer supported since the sole IC manufacturer went out of business. I have seen newer versions from other companies though, but rather expensive. I have some old-tech WUSB devices (not fast enough for useful high-speed video over USB, but okay for motion tracker data).- Thanks man. I just got 2 of this. I'll have my Oculus Rift in early August. Cant wait to start put them together!
new motion capture link here, we just finished a cool project and here's some preview.
http://www.youtube.com/watch?v=Gul7LWna3KI"geekmaster" wrote:
"rldai" wrote:
Hey this is exactly what I'm looking for. Thanks man!
Does it reduce frame rate according to your experience?? I'm planning to transfer 60 fps video through it if possible.
They are reported to have almost zero latency. I believe that these units only support up to 60Hz framerate, with SBS 3D. You *might* be able to push them to 75Hz (still within Rift LCD specifications).
You still need to get your head tracker data back to the host PC. There was speculation that the return channel on these *might* support that (perhaps filtered to a lower data rate by something like an Arduino or Raspberry Pi). It would be easier to use wireless USB for the return channel, but a lot of those (WUSB) products are no longer supported since the sole IC manufacturer went out of business. I have seen newer versions from other companies though, but rather expensive. I have some old-tech WUSB devices (not fast enough for useful high-speed video over USB, but okay for motion tracker data). "rldai" wrote:
new motion capture link here, we just finished a cool project and here's some preview.
Interesting video. Nice motion capture. Is that optical, or IMU based mocap?
Out of abundant personal curiosity, what form of "dance" is that? It appears to be based on a martial art form, but Google did find this for me:"
- I'm guessing there's arduino boards with wifi? Any reason you couldn't push the data down to one of those and spit it out to the PC that way rather than with wireless usb?
"geekmaster" wrote:
"rldai" wrote:
new motion capture link here, we just finished a cool project and here's some preview.
Interesting video. Nice motion capture. Is that optical, or IMU based mocap?
Out of abundant personal curiosity, what form of "dance" is that? It appears to be based on a martial art form, but Google did find this for me:"
- The videos are really impressive - especially the second video. Your physics model for handling flight seems very good and the motion capture seems to approach the quality of optical mo-cap. Thanks for sharing.
- The developers must have ignored the naysayers who claim that positional motion capture with IMUs is impossible (or at least not good enough for head tracking).
"geekmaster" wrote:
The developers must have ignored the naysayers who claim that positional motion capture with IMUs is impossible (or at least not good enough for head tracking).
Well generally I think the naysayers mean that position for a single sensor cannot be determined. Kinematic constraints offers a neat little "cheat" to this limitation but still requires a number of sensors to work well.
I am happy to see people working on this though - bucking the conventional wisdom about optical mo-cap. IMU mo-cap could have major benefits in terms of the variety and scale of environments.
