Enable hand and controller tracking at the same time.

Hi there! As far as I understood, the current hardware (cameras) need to change their exposure modes depending on what they are tracking, which is why simultaneous positional tracking of hands and controller is not supported (correct me if I'm wrong pls)

But is there a way that prevents the Quest from switching to controller tracking on Button inputs in general?

In my setup I want to be able to use the controller as a remote to control what the hand-tracked user is seeing, kind of like a showmaster. I was wondering, if this is an issue with the SDK or if I am doing something wrong.

I use Unity, OpenXR, the Hand Tracking Rig with disabled/removed XR Input Modality Controller Driver as well as deactivated Input Tracking. Yet whenever I press a button on my controllers, the hands stop being tracked.