cancel
Showing results for 
Search instead for 
Did you mean: 

Hand tracking - Interact with 3D widget

Anonymous
Not applicable

Hey,
Is there anyone who successfully used the hand tracking setup to interact with 3D widgets in Unreal Engine? I'm especially interested in poking/touching buttons.

7 REPLIES 7

Brenolucci
Explorer

Same need here

dario.maciel
Heroic Explorer

take a look at this sample
https://github.com/oculus-samples/Unreal-HandGameplay
there is button, grab, punch and other interactions

This sample is really great but the only thing it lacks is exacly what im looking for: Widget interaction with direct touch using hand tracking.

kutlaytunc
Explorer

You can hack it, when finger's collision sphere overlaps with widget; cast line trace and do the similar thing that done in VRTemplate. Like this part: 

kutlaytunc_0-1720556254214.png

 

 

wow! thank you so much! I will try it and return to tell if it worked. 

I did the same for my full body IK in VR. I wrote a plugin so you can put UMG onto static mesh surfaces as well since you can't have a 3d widget curve around your arm like a gauntlet without doing so. 

Well it has: 

kutlaytunc_0-1720627953422.png

 

But not full 360, you are right🤘