Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
wenyingyw's avatar
wenyingyw
Honored Guest
3 years ago

Enable hand and controller tracking at the same time.

Hi,

I have a Oculus Quest Pro, and work on a Unity project that needs hand tracking and controller tracking for a physical object, but I can't enable hand and controller tracking at the same time. So I wonder is this possible? or is there any other ways to track a physical object using Oculus?

15 Replies

Replies have been turned off for this discussion
  • Hi there! As far as I understood, the current hardware (cameras) need to change their exposure modes depending on what they are tracking, which is why simultaneous positional tracking of hands and controller is not supported (correct me if I'm wrong pls)

    But is there a way that prevents the Quest from switching to controller tracking on Button inputs in general?

    In my setup I want to be able to use the controller as a remote to control what the hand-tracked user is seeing, kind of like a showmaster. I was wondering, if this is an issue with the SDK or if I am doing something wrong.

    I use Unity, OpenXR, the Hand Tracking Rig with disabled/removed XR Input Modality Controller Driver as well as deactivated Input Tracking. Yet whenever I press a button on my controllers, the hands stop being tracked.

  • EggPain's avatar
    EggPain
    Honored Guest

    enable this would be great,4-point tracking for hands and feet. Would unlock possibilities for training and dancing games

  • Jay_Ohm's avatar
    Jay_Ohm
    Honored Guest

    In addition to possibly representing physical objects, Quest Pro controllers could be also used to track legs while using hand tracking for hands. And if more than 2 controllers per headset are allowed in software, I wouldn't be surprised if quite a few people buy an extra set or two for proper standalone full-body tracking. It would be even better if a simplified and maybe cheaper "tracker" version of the Pro controller is made available.

  • MetaStoreHelp's avatar
    MetaStoreHelp
    Community Manager

    Hey there wenyingyw! This is a great question, many other users have wondered the same in the past. At this time, it's not quite possible yet to enable both hand and controller tracking. We'd love to hear feedback from our community regarding this, if anyone has any additional insight please let us know! You should also check out our Unity VR Development forum to get in touch with other developers.

    • lucky_hu's avatar
      lucky_hu
      Honored Guest

      This feature would also be fantastic for all motion platform simulator gamers, the controller could help to keep physical and virtual reality in sync and make motion compensation very easy. You can see what I mean in this video: https://youtu.be/7LSXzx5n8lw   We were trying to solve this with Oculus, but for now we will have to use HTC focus 3 because there we can use a tracker during hand recognition.
      Please enable this feature (plus ARUCO code recognition)
      If you do, we will send you a simulator for free 🙂 

    • benengel94's avatar
      benengel94
      Explorer

      This would be so helpful for my work. We use the controllers to track industrial control consoles and we want to use hand tracking at the same time so that people can more easily press the buttons that are on the tracked consoles.