Is there a way to track the virtual position of a real moving object with the Quest? For example a ball that is rolled across a table (example).
Alternatively does anyone have guidance or examples of using one of the quest controllers (maybe the Quest Pro controller is most relevant for this) or some other sensor that can interface with the Quest to get its position without necessarily being held in the user's hand? My use-case is to track a physical robot in mixed reality so that I can display robot relative visualizations (e.g. LiDAR) from the correct coordinate frame / pose.
For now you can only track keyboards, but the headset can track them in real time and they can be any old keyboard. The Trackables API structure also suggests there may be other trackable items in future OS releases.
I have some code you can reference if you're interested. My script is meant for colocation and so only tracks the keyboard for a single frame, but the snippet still shows how you can track keyboards for your own purposes. The official documentation for the API isn't that good
Also, you must turn on keyboard tracking in system settings (under devices) which is off by default! I spent so long trying to figure out why my code wasn't working because of this
