Skip to main content
New Participant
February 26, 2023

About quest pro, how to use face capture data in the real engine 5

Quest pro has the functions of eye expression capture and facial expression capture. But I didn't find out how to get this data in the unreal engine in the document
How can I get this data and the corresponding expression for development in the unreal engine?
I may need some help

This topic has been closed for replies.

3 replies

New Participant
March 1, 2023

In your VRPawn or PlayerPawn be sure to add The OculusXRBodyTracking Component as well as the OculusXRFaceTracking and OculusXREyeTracking Components. In the OculusXRBodyTracking Component it needs a skeletal mesh. Meta has one with all the necessary morph targets in their Movement sample called SK_Proteus. Migrate that Skeletal Mesh into your project and put it in the OculusXRBodyTracking Component.

 

Now in both the Face and Eye tracking Components under Oculus XR>Movement>Target Mesh Component Name, type in OculusXRBodyTracking.

 

This character should be tracking both face and body now.

 

Hope this helped!

SerialMMMAuthor
New Participant
March 29, 2023

I am currently using unreal 5.0.3, metaXR sdk version v47
Didn't see the component you said

Honored Contributor
March 29, 2023

try enabling face tracking in the Oculus XR tab of the project settings
try searching for face, movement, body or eye
try using a more recent metaXR version (the current is v50, but I think it is set up to Unreal 5.1.1) so try v48 or v49