Skip to main content
rldai
Up and Coming
May 27, 2013

Oculus VR with motion capture

{update20140809}
hi guys, we put it on Kickstarter.We worked really hard to make it affordable and easy to use. Now you guys are able to get this kind of stuff home and play with it. We are exhibiting a few days later at Siggragh 2014, booth 533.
Back us :)

https://www.kickstarter.com/projects/1663270989/project-perception-neuron?ref=discovery




{update20131025}


1st Rift/trueMotion MoCap/FPS demo


[updata20130829]
Successfully combined our motion capture system with Oculus Rift.
Now you can walk and run in the virtual world, and you can touch things by using your own hands like this!
Oculus with trueMotion2.jpg
Oculus with trueMotion.jpg



some recent update on VR with motion capture to share here (20130714)
It's in Chinese but I believe you'll understand what I mean
3 screens from left to right
1, from your goggle, 2. 3rd party view, 3. real-time captured video
http://youtu.be/EGZ5Y5x95P4

and... we are flying to Anaheim, California for Siggragh 2013 exhibition next weekend and the week following. Come and check us out!
http://youtu.be/R6pnPggN0Tk



Hi guys,

Here is a motion capture system developed by my team using IMUs (demo videos list below).

0. Peking opera realtime captured
http://www.youtube.com/watch?v=Gul7LWna3KI
1. Fullbody motion capture
http://youtu.be/DPGEG8U7Be8
2. Lowerbody motion capture
http://youtu.be/QgyY3aRtiwk

Those are real-time captured by using match-box-sized wireless IMU sensors.

I'm considering whether it is possible to combine our system with Oculus Rift which will make an idea virtual reality environment.

I’ll start to make Oculus Rift work with my motion capture system as soon as I get the dev kit. For a full body motion capture we need 17 sensors but my thought is that lower body tracking (7 sensors) is good enough for this. Maybe one more for chest?

Although my motion capture system is fully wireless, I think I still need something mobile to feed the video to Oculus Rift. Does anyone know how to transfer DVI video wirelessly? I really don’t wanna carry a 5 pound IBM laptop while running around in my office.

    28 replies

    Show previous replies
    AtariHistorian
    Up and Coming
    July 13, 2013
    "geekmaster" wrote:
    I have five of these, and they work quite well (about 30 feet, through a wall and bookcases). They also have a return channel for remote-control signals.

    That's very interesting. What are you doing with these?
    rldaiAuthor
    Up and Coming
    August 29, 2013
    [updata]
    Successfully combined our motion capture system with Oculus Rift.
    Now you can walk and run in the virtual world, and you can touch things by using your own hands like this!
    Oculus with trueMotion.jpg
    Oculus with trueMotion2.jpg
    Trillium
    New Participant
    August 29, 2013
    Hey Boss man I would really like to network with you I am trying to get it together like you did i am working on it alone and i am not as bright as you and other guys. I would really appreciate it. The positioning been troubleling me for a month..Please help..
    rldaiAuthor
    Up and Coming
    August 30, 2013
    "Trillium" wrote:
    Hey Boss man I would really like to network with you I am trying to get it together like you did i am working on it alone and i am not as bright as you and other guys. I would really appreciate it. The positioning been troubleling me for a month..Please help..

    no problem man, email tristan AT noitom.com plz ;)
    rldaiAuthor
    Up and Coming
    October 24, 2013
    {update20131025}
    1st Rift/trueMotion MoCap/FPS demo

    rldaiAuthor
    Up and Coming
    August 9, 2014
    hi guys, we put it on Kickstarter.We worked really hard to make it affordable and easy to use. Now you guys are able to get this kind of stuff home and play with it. We are exhibiting a few days later at Siggragh 2014, booth 533.
    Back us :)

    https://www.kickstarter.com/projects/1663270989/project-perception-neuron?ref=discovery


    mptp
    Up and Coming
    August 10, 2014
    I made a huge thread about your device, before seeing that you already had a thread about it. So now I feel like a dingus. :D
    Anyway, I have some thoughts about project Neuron, so here they are.
    Firstly: I love you guys. So much. I am 100% a supporter of IMU-based motion-capture as input for VR. I was the hugest ControlVR fanboy of all time. Now I am the hugest ControlVR/Neuron fanboy of all time. I especially like that you've managed to release a product for just about half the price of ControlVR (for the 20 sensor version, which has comparable functionality when used in the upper-body + hands mode to ControlVR's two-armed option).
    However, I have a few questions.

    • 1. How do you achieve objective positional data for the whole forward-kinematic system? I understand that you can use the quaternion output of each Neuron mapped to the the Neuron's position on the body to get each joint's rotation relative to a single point. But how are you saying 'yup, so the index finger is definitely rotated at [52.3, 12.8, -74.2], and it's position is at [12.4, 0.23, 3.8]', without a magnetically or optically tracked reference point? Are you able to use the DK2's position and figure everything out based on that point, or is there something I'm missing?

    • 2. How long would you say a complete body + finger tracking setup of Neurons would take to put on / take off? It looks somewhat involved, which is fine for long sessions in VR, but not so fine if you only want to hop into VR for 15 minutes or so.

    • 3. Are the gloves that you show on the kickstarter page how the finished gloves are going to look. And if so, might I suggest a redesign before you ship? I know you mentioned that they're only a prototype, but even still...the first thing I thought after I got over my initial 'oh my god oh my god this is amazing' was 'jesus those gloves look awkward'. Specifically the little Loch-Ness-Monster effect of the cables connecting each Neuron. Obviously it's a challenge because of how the finger-bend increases the distance that the cables need to go, but surely there's some way to work it out. :D



    But basically, yeah congratulations on making such an awesome product! I would totally back you if I wasn't totally broke right now. Hopefully I can come up with $550 within 35 days. :D
    Melbourne-based creative technologist. I flit between experimental AR/VR experiences, audiovisual electronics and full-stack web development. http://www.lachansleight.io
    rldaiAuthor
    Up and Coming
    August 19, 2014
    hey, Thanks for the support @mptp ! sorry for the late reply though.

  • 1. How do you achieve objective positional data for the whole forward-kinematic system? I understand that you can use the quaternion output of each Neuron mapped to the the Neuron's position on the body to get each joint's rotation relative to a single point. But how are you saying 'yup, so the index finger is definitely rotated at [52.3, 12.8, -74.2], and it's position is at [12.4, 0.23, 3.8]', without a magnetically or optically tracked reference point? Are you able to use the DK2's position and figure everything out based on that point, or is there something I'm missing?


    • First of all it's not a whole fwd kinematics system. If it is so you are not able to capture large rigid body dynamics like jumping, running and flipping. We have a very special patented algorithm doing all the physics calculation their estimating the position all the time and canceling out the drift from time to time. I would like to let you know more but please let's do it privately through email or phone. There still will be error accumulation for positioning but it could be minor for relatively short period of time. We do not support DK2's camera based positioning and we do not plan to do it coz by using our system or any ODT, you'll turn 360 degrees somehow or walk away from the camera from time to time.

  • 2. How long would you say a complete body + finger tracking setup of Neurons would take to put on / take off? It looks somewhat involved, which is fine for long sessions in VR, but not so fine if you only want to hop into VR for 15 minutes or so.

    • For me the world's most experienced user, it takes 5-6 mins to put on fullbody and fullhands (current engineering prototype). My plan is to make it within 3 mins for you guys, a typical time for startup a console/PC and startup your APP.

  • 3. Are the gloves that you show on the kickstarter page how the finished gloves are going to look. And if so, might I suggest a redesign before you ship? I know you mentioned that they're only a prototype, but even still...the first thing I thought after I got over my initial 'oh my god oh my god this is amazing' was 'jesus those gloves look awkward'. Specifically the little Loch-Ness-Monster effect of the cables connecting each Neuron. Obviously it's a challenge because of how the finger-bend increases the distance that the cables need to go, but surely there's some way to work it out. :D


    • Yes we are working with the ID team days and nights for an update, I will post an updata later on. Thanks for the suggestion!

    But basically, yeah congratulations on making such an awesome product! I would totally back you if I wasn't totally broke right now. Hopefully I can come up with $550 within 35 days. :D

    Thank you , please do back us and we will not fail you :)

    Tristan Dai
    Terms & ConditionsAccessibility statement