Skip to main content
Theformand
Participant
December 22, 2019

Handtracking and Unity UI

Hey everyone.

Since we dont have hand tracking in-editor via Link (Guys please tell me this is coming, dont see how handtracking development will take off without it), I´m working on a small tool app to record and serialize hand poses for pose recognition in a game.
So, I would really like to have a way to interact with Unity UI. Raycast and click, thats all I need. I tried making my own HandTrackingRaycaster to use with a Canvas, but it doesnt seem to be working. Is there really not a built-in component for this?

    This topic has been closed for replies.

    13 replies

    Show previous replies
    Anonymous
    March 3, 2020
    any further info on this i also cant seem to get hand tracking working with unity ui
    platymatrix
    New Participant
    July 15, 2020
    As far as I know you can follow this tutorial here: (It won't let me post a link, but go to YouTube and search for Valem and User Interface. Then if you see "How to make a VR Game Part 4 User Interface" it's the right one)
    to get the UI set up

    And then after that write a script that changes the OVRInputModule to have ray.Transform = hand.PointerPose. That worked for me. You'll also have to use your laserpointer from the video as the pointer in your OVRRayCaster. Hope that helps. 

    Note: If you're using the UI Helpers from the video you'll have to comment out one line of code in the HandedInputSelector which sets the ray transform to be the right hand anchor. That will interfere with the other script. 
    Terms & ConditionsAccessibility statement