Forum Discussion
Setting up Multimodal hands & controllers
Hi,
I am trying to run Multimodal feature outlined in Meta recent blog posts (https://www.uploadvr.com/meta-quest-pro-simultaneous-hands-controllers-mode/).
My device is Quest Pro with OS version 57.0.0.261.669 and Quest Pro controllers. I am working in Unity 2022.3.10.
So far, I am failing to make this feature work. The settings of my OVRManager are:
When I try to run it on device, I am getting the following message in the logs:
"Failed to set multimodal hands and controllers mode!"
Do you have any idea what I am doing wrong?
25 Replies
Hey!
I am experiencing a similar issue. I think I set up the multimodal hands and controllers option the same way, but the result that I get is seeing my hands or the controllers, not both at the same time. I got to see my left hand if I hold the right controller with the right hand (that immediately changes to the controller), but I am not able to see my hand while holding the controller ad the video of the blog...
I'm also wondering how to enable this new feature. I imagine the reason it fails in Unity is because it first has to be activated in the headset or via the Oculus app, but I couldn't find any "Multimodal" feature in the settings, including in "Experimental".
Yes, I am having the same problem. Moreover, I have the same software version and meta headset. I will still try to figure out how this work. If I do, I will tell you! Please, do the same.
Does anyone find the solution for this issue? Now I am trying to make it work with SDK v57 but still has no luck. I cannot run the "MultimordalHandsAndControllers" sample scene properly.
Do you have experimental enabled on your device?
adb shell setprop debug.oculus.experimentalEnabled 1and experimental ticked on in the OVRManager might be important too
Hey, thank you for your advice. Now it seems working somehow in my project. I did not notice that was one of the experimental feature.
I did, but it doesn't work as the gif that you can see here: https://www.uploadvr.com/meta-quest-pro-simultaneous-hands-controllers-mode/ (which is seeing the controller while using the hand tracking). For me, it works as what you see in this video... https://drive.google.com/file/d/173sddlVS7bVM4CDwteS89hEetA_dS3_2/view?usp=share_link
First, I start with both controllers, but few seconds after starting the video, I quit the controller from the right hand. Hence, as you can observe, I am using the left controller, and the right hand tracking. Everything is correctly working, but not as expected. I want to see the controllers at the same time, as shown in the gif of the other website. Why? Because for me, it would be very interesting to use the controller as an object tracker.
I wrote a script to see the 3D models of the controllers all the time, but the position doesn't update if you're not using them...
Hello,
I'm sorry you are getting issues. This might be related to the way the anchors are set up. Have you made sure to follow the steps here:
https://developer.oculus.com/experimental/multimodal/
Specifically, step 4 in the "From Unity" section?
Thanks!
Hello,
I've also been trying to have this feature working but on Quest 3 with quest 3 controllers. My unity version is 2022.3.10 and Meta's SKD one is 59.0. Does someone know if we can have simultaneously hands and controllers in this configuration with quest 3 please ?
Best,As far as I know, multimodal input works with touch pro controllers. You can use the functionality only when you pair your Quest3 with the touch pro controllers.
did you try the latest SDK? - https://twitter.com/Lunayian/status/1758271646966702331
Oh, it is not experimental. It is now official. It's huge!
Where are those settings because I would like to disable it when it comes to my headset.
