Forum Discussion

Pokenic_Huskywolf's avatar
Pokenic_Huskywolf
Honored Guest
12 months ago

Unreal - Use Take Recorder with Live Link for Hand Tracking as Motion Capture?

Hi everyone,

I'm trying to record an animation in Unreal using the Hand Tracking of the Quest 3 and 2 as a motion capture and once recorded I need to export the animation for future use.
When I record with the Take Recorder, the only things that move are the rotation and location of the Motion Controller Components.
I searched for a Live Link connection but found only the tracking for body and face with Quest 2.

Is there a function for recording the Skeletal Mesh movements of the hand with the Take Recorder?
(I found this Post similar to my question but didn't know how to record the bone transforms.)

Is there a Live Link connection for the Hand Tracking?

I'm using the Meta XR plug-in and already set it for Hand Tracking only.

animation
Hand Tracking
Hands tracking
Live Link
MetaXR Plugin
motion capture
OpenXR
Unreal
Unreal 5.3.2

2 Replies

  • Pokenic_Huskywolf's avatar
    Pokenic_Huskywolf
    Honored Guest
    12 months ago

    I just found out how to record the hand tracking: when you put the Actor with the skeletal mesh of the hands in the Take Recorder, you need to check "Animation Track" in the skeletal mesh component.

    PS: before putting the actor inside the Take Recorder I put custom hands with an Anim blueprint, like here, to sync the Meta hands with the custom ones to have access to the Skeletal Mesh settings in the Take Recorder, like the "Animation Track"

  • Korhi's avatar
    Korhi
    Honored Guest
    13 days ago

    After experimenting with numerous skeletal and motion retargeting methods, I've discovered a remarkably straightforward and effective approach using the Meta Movement SDK: Meta Movement SDK Documentation.

    Released by Meta in Q1 2024, this full-body tracking algorithm provides comprehensive hand tracking, extends coverage to the arms, and leverages AI computation for lower body movement. Currently, by simply downloading the Movement SDK Sample for Unreal from GitHub Oculus Samples and installing the Meta XR plugin, users can immediately run the sample and directly capture animations using Take Recorder without any complicated setup.