Finding Controller position even when not in hand

Hi, I'm developing a Unity game, and I'm currently using the Meta Quest 3.

I'm trying to use both the hand tracking and controller tracking simultaneously, even when the controller is not in your hand.
I have been able to make the controller tracking and hand tracking happen simultaneously when you're holding the controller (so that you see both the controllers and your hands). However, when you put the controller down, it disappears almost immediately. I need the controller to stay active and visible, while als showing the hand tracking.

How can I make that happen? Thanks in advance.

P.S. Alternatively, it's fine if I briefly need to switch to controller only, as long as I can get the position of a controller that is NOT in your hand.