Face tracking

14 Topics

Quest PRO - after V.81, half of the face tracking stopped working (the left eyelid does not move)
Quest PRO - after V.81, half of the face tracking stopped working (the left eyelid does not move). Verified - left eyelid does not move in the home world on Quest Pro itself. Verified - the left eyelid does not move precisely when tracking the face. Verified - the right eyelid moves and fully works in face tracking. Verified - the left eye moves with the right. It is the left eyelid that does not work. Verified - I turned face and eye tracking on and off 10 times, restarted Quest Pro 10 times, logged into my helmet and PC account 10 times, and Factory reset Quest Pro 10 times. The Quest Pro backlight is in working condition. Quest Pro has been kept clean in the factory box for over 9 months. Quest Pro was used for no more than 2 months in a room without contamination, without water, without dirt, without hitting objects, without throwing, without throwing on the floor. Quest Pro was immediately upgraded to v.74 and v.81 with Wifi updates only at 100% battery charge. What could have gone wrong? Please correct it.
AlexCV7493
5 months ago Place Other Troubleshooting
172Views
0likes
1Comment
Enabling Facial Expressions on Networked Avatars
Hi all! I'm looking to enable face tracking for a multiplayer game I'm currently developing where each avatar is network instantiated. The current documentation explains how to set it up for local avatars. Is there any documentation available for networked instantiated avatars?
SupernovaAdmin
9 months ago Place PCVR/Link Development
4.4KViews
0likes
6Comments
Is there an update on Quest Pro Tongue Tracking?
This Question was asked some time ago and a Community Manager answered with "We are looking into it". But I wanted to ask if there is any update on the tongue tracking for Quest Pro. So far I'm rather happy with the face tracking capabilities but one thing that's definitly missing is tongue tracking. It's one of the first things people ask about when they notice someone is using facetracking with a Quest Pro. And if it would be added, this headset would basically be perfect in my eyes. Is anyone else sharing this mentality?
Solved
OverlayFox
1 year ago Place OpenXR Development
2.8KViews
6likes
2Comments
Additional Tongue Tracking BlendShapes
There are currently seven BlendShapes for tongue tracking which primarily only allow for inwards/outwards positioning. https://developer.oculus.com/documentation/unity/move-face-tracking/#face-blendshapes Some further implementation allowing for simple lateral left and right positioning would greatly improve the potential feature applications. Additional development could include both vertical and lateral manipulation, as well as morphing. This would be in similarity with competing HMD face tracking implementations.
Nhex
1 year ago Place Unity Development
938Views
2likes
1Comment
Network face tracking Meta avatars
I have working Unity app using Meta avatars. Lipsync works well - other network players see my face moving. So data is receiving correctly. But! When I introduced face tracking, it only works locally. Nobody see my facetracking except me. I'm using the pair of Sample avatar entities (local and remote) on my network player prefab. Everything works except sending facetracking. Can you help me?
Instavr.ru
1 year ago Place Unity Development
1.2KViews
0likes
1Comment
Failed to Start Face Tracking Error Message
Hello! I am developing a project in Unity that utilizes the face tracking, hand tracking, and eye tracking features of the Meta Quest pro. I have followed the tutorial on Meta's developer website here. I imported the movement SDK and enabled the necessary features under the OVRCameraRig (Quest Features and Permission Requests on Startup). However, no matter what I do, the only thing that is working in the Aura Sample Project is hand tracking. The avatar's face and eyes do not move at all. In the Unity console, I get errors that say "failed to start face tracking" and "failed to start hand tracking." I am using Unity version 2022.3.13f1. I also pulled another sample project from Github that someone developed to test face and eye tracking and I am seeing the same issues there. I researched prior instances of this happening with other developers such as here and I followed the steps that helped them resolve the issue such as enabling the public beta channel of the Oculus app and ensuring the Quest Pro was fully up to date, however, no matter what I do, nothing seems to resolve the issue. I have also enabled the face tracking and eye tracking checkboxes under the beta features section of the Oculus PC app. Furthermore, face tracking and eye tracking appears to be working in the home environment of my Quest Pro as the avatar there reflects my face and eye movements. I would appreciate any and all help in resolving this issue. Thank you!
Solved
Gamerprime
2 years ago Place Unity Development
1.7KViews
0likes
1Comment
Face Tracking - FaceExpressions Data
I use Unity 2021.3.20F1 and Oculus Integration V54. I can perform facial tracking and AURA with my face expression. Based on research purposes, I need to store information about facial expression weights. But when I store the information about OVRFACEEXPRESSIONS.TOARAY (), the game will be stuck. Is there any way to allow me to store the information and not stuck?
wmlabwmlab
2 years ago Place Unity Development
847Views
0likes
0Comments
Network face tracking Meta avatars
I have working Unity app using Meta avatars. Lipsync works well - other network players see my face moving. So data is receiving correctly. But! When I introduced face tracking, it only works locally. Nobody see my facetracking except me. I'm using the pair of Sample avatar entities (local and remote) on my network player prefab. Everything works except sending facetracking. Can you help me?
Instavr.ru
2 years ago Place Quest Development
802Views
0likes
1Comment
About quest pro, how to use face capture data in the real engine 5
Quest pro has the functions of eye expression capture and facial expression capture. But I didn't find out how to get this data in the unreal engine in the document How can I get this data and the corresponding expression for development in the unreal engine？ I may need some help
SerialMMM
2 years ago Place Unreal Development
4.2KViews
0likes
3Comments
Passthrough Shadows Discussion
I'm currently looking into the best way to implement shadows for virtual characters. I've seen a few ways that look promising with just drop shadow cards. But what if I want true dynamic shadows? How do I get them to cast with no floor mesh since I want Passthrough? Or even dynamic soft shadows? I came across this for dynamic soft shadows based off the collision which looks pretty good. But how would I implement that with Passthrough? https://www.youtube.com/watch?v=_oed7fqqzaY Here is a sneak peak at the current project. The characters still don't feel grounded yet without shadows. Just trying to find the best and most realistic way. https://twitter.com/colin_a_brady/status/1627061040939941888?s=20 Please share your thoughts an how you think the best way to implement a shadow for so many characters should work in Passthrough!
AMGI.Studios
3 years ago Place Unreal Development
2.4KViews
0likes
2Comments