Forum Discussion
Setting up Multimodal hands & controllers
Hi, I am trying to run Multimodal feature outlined in Meta recent blog posts (https://www.uploadvr.com/meta-quest-pro-simultaneous-hands-controllers-mode/). My device is Quest Pro with OS version 5...
Do you have experimental enabled on your device?
adb shell setprop debug.oculus.experimentalEnabled 1and experimental ticked on in the OVRManager might be important too
I did, but it doesn't work as the gif that you can see here: https://www.uploadvr.com/meta-quest-pro-simultaneous-hands-controllers-mode/ (which is seeing the controller while using the hand tracking). For me, it works as what you see in this video... https://drive.google.com/file/d/173sddlVS7bVM4CDwteS89hEetA_dS3_2/view?usp=share_link
First, I start with both controllers, but few seconds after starting the video, I quit the controller from the right hand. Hence, as you can observe, I am using the left controller, and the right hand tracking. Everything is correctly working, but not as expected. I want to see the controllers at the same time, as shown in the gif of the other website. Why? Because for me, it would be very interesting to use the controller as an object tracker.
I wrote a script to see the 3D models of the controllers all the time, but the position doesn't update if you're not using them...
Almxdena, you're right. Initially, I was considering using the controller as an object tracker. While I did succeed in a certain kind of simultaneous use of hand tracking and controller tracking, I couldn't achieve the true simultaneous behavior as shown in your linked video. Currently, what I can achieve is a concurrent simultaneous use where one hand uses hand tracking and the other uses controller tracking, with proper mesh rendering. I can't track the released controller. If it's possible to track the released controller as a 6DOF tracker in the state shown in the linked video, I'd love to know how, and I believe that's the functionality developers desire. However, even in the linked video, the released controller isn't moving. This means that they might just be displaying the controller mesh on the table the moment the controller is released and hand tracking is activated.
I think you're right. It appears that the controller mesh is constantly visible in the video, and its position likely remains static. I think we'll have to wait for future versions of the SDK...
