Skip to main content
shadeemry
Participant
March 11, 2015

Infared Digital hand tracker for keyboard input

Has anyone pondered that with the dk2 tracker that we may be able to make a glove with SMC IR LED's in gloves at the basic hand parts for a virtual keyboard operation that would load with a recognized swipe to give us access to a virtual keyboard? i am more of a hardware guy , so I am not sure if the SDK allows us to tap into the XYZ tracker and allow us to search for LED's emitting at a different frequency so the source would be able to distinguish the headset from the gloves. How possible do you guys think that this can be done?

    4 replies

    kojack
    kojack
    Honored Contributor
    March 13, 2015
    "shadeemry" wrote:
    i am more of a hardware guy , so I am not sure if the SDK allows us to tap into the XYZ tracker and allow us to search for LED's emitting at a different frequency

    The sdk doesn't allow this. The led tracking isn't exposed, you just get the calculated position and orientation of the hmd.
    While most of the sdk has source code available, the camera stuff is in the closed area.

    You'd need to bypass the oculus sdk and access the camera directly (some people have done this) and write your own tracking code.
    Author: Oculus Monitor , Auto Oculus Touch , Forum Dark Mode , Phantom Touch Remover , X-Plane Fixer Hardware: Threadripper 1950x, MSI Gaming Trio 2080TI, Asrock X399 Taich Headsets: Wrap 1200VR, DK1, DK2, CV1, Rift-S, GearVR, Go, Quest, Quest 2, Reverb G2, Quest 3
    nosys70
    Up and Coming
    March 13, 2015
    you don't need this, you just need a wireless IMU on the wrist (provided you are happy with one finger typing).
    you can use a 10$ wireless air mouse for that.
    Matlock
    Up and Coming
    April 9, 2015
    As described, I don't think this idea is possible.

    I assume that the oculus camera derives the depth of the headset based on scale of the projected points. It expects that every DK2 unit is EXACTLY the same size.

    This same technique wont work with a glove because of all the deformation, and different size hands. The single camera will not be able to tell how far away from the camera the glove is, so It will not be able to provide accurate X,Y,Z data. The Leap motion device has 2 cameras, and it uses reverse stereo projection to derive the depth(distance from camera)
    lmaceleighton
    Up and Coming
    April 12, 2015
    As far as what is "possible": It IS possible to do what you ask, but they are correct that the SDK, and the Drivers that operate the DK2 Camera will not operate in that manner, however it CAN be done. You will need to create your own custom drivers and software. To get around this you can get a Chap PS3 Eye Camera, and do the IR MOD, so that it ONLY sees in IR. Then with some IR LED, or some Retro-reflective tape, and an IR light, and OPEN CV, you could totally do it, you'll just have to program it yourself. Open CV is great, and I have used it for a couple of project that are all about tracking things for VR, but its not easy, good luck:O)

    PS: Nothing is impossible
    ~B :ugeek:
    Terms & ConditionsAccessibility statement