Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
shadeemry's avatar
shadeemry
Honored Guest
11 years ago

Infared Digital hand tracker for keyboard input

Has anyone pondered that with the dk2 tracker that we may be able to make a glove with SMC IR LED's in gloves at the basic hand parts for a virtual keyboard operation that would load with a recognized swipe to give us access to a virtual keyboard? i am more of a hardware guy , so I am not sure if the SDK allows us to tap into the XYZ tracker and allow us to search for LED's emitting at a different frequency so the source would be able to distinguish the headset from the gloves. How possible do you guys think that this can be done?

4 Replies

  • "shadeemry" wrote:
    i am more of a hardware guy , so I am not sure if the SDK allows us to tap into the XYZ tracker and allow us to search for LED's emitting at a different frequency

    The sdk doesn't allow this. The led tracking isn't exposed, you just get the calculated position and orientation of the hmd.
    While most of the sdk has source code available, the camera stuff is in the closed area.

    You'd need to bypass the oculus sdk and access the camera directly (some people have done this) and write your own tracking code.
  • nosys70's avatar
    nosys70
    Expert Protege
    you don't need this, you just need a wireless IMU on the wrist (provided you are happy with one finger typing).
    you can use a 10$ wireless air mouse for that.
  • Matlock's avatar
    Matlock
    Honored Guest
    As described, I don't think this idea is possible.

    I assume that the oculus camera derives the depth of the headset based on scale of the projected points. It expects that every DK2 unit is EXACTLY the same size.

    This same technique wont work with a glove because of all the deformation, and different size hands. The single camera will not be able to tell how far away from the camera the glove is, so It will not be able to provide accurate X,Y,Z data. The Leap motion device has 2 cameras, and it uses reverse stereo projection to derive the depth(distance from camera)
  • As far as what is "possible": It IS possible to do what you ask, but they are correct that the SDK, and the Drivers that operate the DK2 Camera will not operate in that manner, however it CAN be done. You will need to create your own custom drivers and software. To get around this you can get a Chap PS3 Eye Camera, and do the IR MOD, so that it ONLY sees in IR. Then with some IR LED, or some Retro-reflective tape, and an IR light, and OPEN CV, you could totally do it, you'll just have to program it yourself. Open CV is great, and I have used it for a couple of project that are all about tracking things for VR, but its not easy, good luck:O)

    PS: Nothing is impossible
    ~B :ugeek: