Forum Discussion
Hand tracking - Interact with 3D widget
Hey,
Is there anyone who successfully used the hand tracking setup to interact with 3D widgets in Unreal Engine? I'm especially interested in poking/touching buttons.
11 Replies
Replies have been turned off for this discussion
Same need here
take a look at this sample
https://github.com/oculus-samples/Unreal-HandGameplay
there is button, grab, punch and other interactionsThis sample is really great but the only thing it lacks is exacly what im looking for: Widget interaction with direct touch using hand tracking.
You can hack it, when finger's collision sphere overlaps with widget; cast line trace and do the similar thing that done in VRTemplate. Like this part:
wow! thank you so much! I will try it and return to tell if it worked.
I did the same for my full body IK in VR. I wrote a plugin so you can put UMG onto static mesh surfaces as well since you can't have a 3d widget curve around your arm like a gauntlet without doing so.
Well it has:
But not full 360, you are right🤘
please with meta Xr plugin how do you get access to hand skeletal mesh (so that you can place sphere collision on finger tip). please i am new to hand tracking, and i usually have the hands by default at runtime only.
There are 2 different hands Ive used;
1- Hand component: Base hand mesh that we see in game
2- Hand skeletal mesh component: Can be added to pawn and syncs with hand component's mesh, so we have usable skeletal mesh
You need:
1- A hand skeletal mesh
2- Make sphere collider component
3- Scale it down for finger tip
4- Set it's parent as the bone you want in details panel
I hope it helps
