Hello Meta, I would like to report an issue with your OpenXR runtime and Quest functionality.
In my game, I rely on Body Tracking as a standard feature that's supported on all Quest headsets, but would also like to use multi-modal mode with controllers when available, in order to use Controllers (or Logitech MX Ink) at the same time as not only hand tracking, but body tracking as well. Seeing your fingers wiggle around accurately is really nice, for gestures and realism.
Since hands are a part of the body, and finger joints are tracked just fine when I put the controllers down and it switches modes, I don't see why, technically, multi-modal would only work for hand tracking EXT (without body tracking) and not the full body API which includes hand tracking.
I reported this issue before but was told it wasn't a good place to do it:
Aside: I'm sure I'm not the only one who would like to use body tracking and controllers at the same time, and for example, I just received the Logitech MX Ink which is technically a controller, and I'm sure many devs and studios making social VR painting apps would appreciate having their bodies represented faithfully while also being able to use the stylus device.
So fixing this issue here would fix it for Logitech's new pen as well, which works fantastic btw.
@johnkearney Hi John, hope you're doing well. I see you're still around these parts.
Can you take a look at this issue? I have several apps that are in flight now for both myself and my clients that require body tracking, but would benefit from multimodal support (1 controller + 1 free hand).
This includes the new Logitech MX Ink which I have, but sadly it doesn't allow one Touch controller and the stylus to be used at the same time, which is disappointing. Anyway, I really need body tracking and being able to see my hands / forearms at the same time as use this new Pen for a new app, can you guys / gals take a look at fixing this issue with mutual exclusivity of multi-modal vs FBT? It's really limiting me.
I'd also love to be able to pair two MX Inks at the same time and do various fun things with a second player on a 2D flatscreen, for example (collaborating. not everyone wants to be in VR). There are also plenty of fun gameplay possibilities aside from art apps, like assymmetric gameplay (remember Wii U?). An extra player can tap on the screen to drop new platforms the other players can jump onto.
Hi @neurodivrgent , can anyone at Meta confirm whether this but will be fixed?
I just tested my Logitech MX Ink stylus in my app but I really need FBT and finger tracking at the same time for immersion. It's just awful looking that the fingers aren't moving when you're painting stuff.
