Skip to main content
Up and Coming
July 29, 2014

Strapping a Leap Motion Controller onto the DK2

Would strapping a Leap Motion Controller onto the DK2 cause positional tracking to go haywire?

    18 replies

    Up and Coming
    August 1, 2014
    Also keep in mind that you can cover up a few of them and not do too much damage to the quality of positional tracking. However, why not try mounting the Leap Motion onto your chest or shoulder? I haven't played with a Leap Motion so I'm not sure what the details of its tracking volume are like, but if you could mount it to your torso and still be able to track your hands when your arm is outstretched, that would be ideal, no?

    I just had a nifty idea for body tracking: what if you had a sort of forward-kinematics based series of Leap-Motion style 3D optical trackers. The end point is an actual Leap Motion mounted on your forearm somehow such that it can always track your hand no matter your arm configuration. And you track the position of that Leap Motion controller using a DK2-style optical tracker that has a large tracking volume. This gives you the absolute position of the wrist, and the relative positions of all the finger joints when compared to the wrist position. :D
    Melbourne-based creative technologist. I flit between experimental AR/VR experiences, audiovisual electronics and full-stack web development. http://www.lachansleight.io
    Participant
    August 1, 2014
    "InteriorD" wrote:
    "yezzer" wrote:
    "InteriorD" wrote:

    I'm beginning to think we either have the wrong information or I'm getting my leg pulled. I've tried over and over again to look at my DK2 with my iPhone camera, and it's clear that there's no infrared emitters on the HMD itself. The picture linked earlier should be that of a case-less Crystal Cove and not the DK2.



    Here's a pic of the LEDs that I just took on my Nexus 5. They are there!

    https://dl.dropboxusercontent.com/u/257507/dk2_leds.jpg


    Oh wow, they're really subtle. Maybe that's why I missed them on my iPhone. Thanks a ton! Really appreciate it.

    Some cameras also have IR filters in them in which case you wont see the LEDs.
    InteriorDAuthor
    Up and Coming
    August 1, 2014
    "Grrizz" wrote:
    Some cameras also have IR filters in them in which case you wont see the LEDs.

    Another poster in another thread has pointed out that the newer iPhones have IR filters, which is why it didn't work for me.

    "mptp" wrote:
    Also keep in mind that you can cover up a few of them and not do too much damage to the quality of positional tracking. However, why not try mounting the Leap Motion onto your chest or shoulder? I haven't played with a Leap Motion so I'm not sure what the details of its tracking volume are like, but if you could mount it to your torso and still be able to track your hands when your arm is outstretched, that would be ideal, no?

    I just had a nifty idea for body tracking: what if you had a sort of forward-kinematics based series of Leap-Motion style 3D optical trackers. The end point is an actual Leap Motion mounted on your forearm somehow such that it can always track your hand no matter your arm configuration. And you track the position of that Leap Motion controller using a DK2-style optical tracker that has a large tracking volume. This gives you the absolute position of the wrist, and the relative positions of all the finger joints when compared to the wrist position. :D


    The main reason for wanting to mount it on the Rift is to create an all-in-one solution for both VR visuals and control. By mounting it onto the HMD all you'll have to do is don the Rift and everything is good to go. Strapping it onto the chest or shoulder will require too much work on the part of the user. On top of that, Leap supports a head mounted position for its hardware but it's unclear whether a chest-mounted position is even workable due to its position relative to the hands and fingers.

    I'm having a hard time visualizing your idea in terms of placement on the forearm... Do you mind drawing a quick MS Paint picture?
    Participant
    August 30, 2014
    August 30, 2014
    Exactly like that :) ordered mine as soon as it was launched!
    Participant
    August 30, 2014
    Wouldn't this problem be better solved by using the soon to be released kinect 2.0 for windows? The only advantage I can see to the leap is the ability to track your hands when your back is to the camera.
    August 30, 2014
    They're similar devices! But leap is small enough for it to attach directly to the HMD, and the latest SDK allows access to the cameras, giving you an AR display, albeit they are IR only. Pretty good though!

    Kinect 2 is out BTW.
    Up and Coming
    August 31, 2014
    LEAP Motion's new V.R update.. is supposed to take care of many issues the Leap suffered previously when using the device docked to a HMD. for example if the background keeps changing.. the Leap could not properly pickup the finger locations in space.

    I have the Leap Motion already & its a great piece of kit.. especially for the price. I just ordered the newly released Leap DK2 mounting kit. should be interesting... but one thing I'm puzzled about is the fact it ships with an extended USB cable.. but doesn't the DK-2 have a USB-in located on the front of the HMD that the Leap could make use of .. ??

    the Kinect is a totally different device that should not be considered over something like a Leap Motion..

    Kinect is geared towards full body MoCap & now it's faster & able to track facial gestures. I tend to use for MoCAp work to import FBX files into Unity for Mecani.

    Leap on the other hand is geared towards real time precision hand gestures & now V.R... I envisage shortly we'll begin to see Daisy chained Leap Motions. They're small enough to add secral to different areas.. perhaps on for each hand rather than one detecting both. If you had the Leap mounted to your wrist & slightly raised to capture the positioning.. then you could move your hands out of view & still be able to conduct finger tracking... yes ?

    I'm wondering how a Leap could be used in conjunction with the new Sixense Stem system ??
    http://www.mickbanks.com