Forum Discussion
Solved
How to get data from quest3 color camera, or get data from passthrough, but in video streaming form?
I want to make an application where one of the steps is to make sense of the items around me, I initially wanted to use the self contained scene understanding but I found out that it has to do a spat...
Sure. In our case, we only need to track a small amount of objects (5) in the app, that is why we can use external trackers. We are using HTC Vive Ultimate Trackers for it. Of course, if in your case you want it to be dynamic tracking for all the environment then this option is not very suitable. For you, the only way of doing it I see is adding a camera on top of the Quest and using that image to run a object recognition algorithm in it. The problem of this is that you have to find the way of passing the information from this camera to a server (to run the algo.) and then pass this info to the Quest.
It's really unfortunate that we have to work in this difficult solutions when there is existing technology to do all of this in the HMD in real time. Good luck with that!
What are external trackers? Can you tell me more about it?
Sure. In our case, we only need to track a small amount of objects (5) in the app, that is why we can use external trackers. We are using HTC Vive Ultimate Trackers for it. Of course, if in your case you want it to be dynamic tracking for all the environment then this option is not very suitable. For you, the only way of doing it I see is adding a camera on top of the Quest and using that image to run a object recognition algorithm in it. The problem of this is that you have to find the way of passing the information from this camera to a server (to run the algo.) and then pass this info to the Quest.
It's really unfortunate that we have to work in this difficult solutions when there is existing technology to do all of this in the HMD in real time. Good luck with that!