Forum Discussion

Brenolucci's avatar
Brenolucci
Explorer
2 years ago

Hand tracking widget interact through direct touch

Hi! I am new to VR development and im really struggling to find those trivial solutions. Sorry about my ignorance but i would like to know how can i interact with widgets interfaces in Unreal Engine. I already have a sample project with leap, grab, button and all set but widget interaction. 

My goal is to create a custom keyboard with some specifc functionalities. If anyone can help me i would appreciate a lot! 

thank you!

Development
direct touch
Hand Tracking
Meta XR
Unreal Engine
widget interface
widgets

2 Replies

  • Starkium's avatar
    Starkium
    Protege
    2 years ago

    hello, I made a solution for this for my project (not hand tracked, but possible)

    I attached spheres to my characters fingertips. I'm using a collision channel just for UI, but you don't necessarily have to. Then on hit from the sphere I get the impact normal, reverse it, and tell a widget component to do a custom hit/press with the supplied data from the sphere's impact. 

    • Brenolucci's avatar
      Brenolucci
      Explorer
      2 years ago

      Great! could you show me your blueprints? Idk exacly how to attach the sphere on fingertips nor to activate the custom hit