Forum Discussion
Solved
Can I access Quest 3's front camera?
I want to make MR app using Computer Vision technology. But I don't know How can I access my VR's front camera. I want to get front camera's image to process. Can I access Quest 3's front camera?
You can now access the Meta Quest's Passthrough Camera: https://www.youtube.com/watch?v=1z3pcMJbnRA
See samples here: https://github.com/xrdevrob/QuestCameraKit
Official Passthrough Camera Samples: https://github.com/oculus-samples/Unity-PassthroughCameraApiSamples
Documentation: https://developers.meta.com/horizon/documentation/unity/unity-pca-overview
Can we get a reply from Meta about this? This doesn't any sense to me. I would also like to start working on computer vision applications using the quest 3. That's one reason I bought one...
We have a device that can do spatial tracking. What if I wanted to track against irl objects to power an application? This has many uses.
1. Track specific pieces on a VR tabletop game, showing information/animations on top of them.
2. Ask quest to 'track' an object you are holding and show you where it is afterwards. (universal, 'find this for me' app)
Is there an obvious alternative to these methods? Can we access the display data perhaps during a passthrough and use that for training computer vision models?
I have a question for you , le't's suppose that it works, computer vision will return only x and y how could we detect the profondity (z) ?
thanks..
In Unreal there is a built in node "Get Screen Location to World Space" that does what you want but I'm not sure how it behaves in a Quest which has 2 offsetted displays for each eye.
Also Ditto. How can we build true mixed reality apps if we cant compute the real world data. Frustrating...Meta already relented and said they are planning to give some level of developer access to the cameras. I would expect to see it sometime later this year.
Awesome, I hope it wont take too long.
