Forum Discussion
AndrewSmigaj
3 years agoHonored Guest
Any future for mixed reality applications on Quest Pro that track real-world objects?
After purchasing a Quest Pro, because I wanted to explore mixed reality applications that track real-world objects, I found out that it is not possible yet because they don't let applications use camera data due to 'privacy concerns'. You can't even track AR tags.
Since this is a mixed reality headset it seems this would be an essential functionality and priority for them. People use camera data all the times all the time on phones to create mixed and augmented reality applications.
Is this something we will see them eventually release an SDK for (like AR Foundation) or should I just return it? Attaching a separate webcam on my headset is not an option.
2 Replies
- tcs.research.2023Honored Guest
Hey, have you found something regarding this matter?
I wanted to use AR-Core to track objects and planes in the environment and use colliders on them for a physics-based simulation (I did not want to use the "Experimental room setup" provided by VR Oculus). But the camera can not be accessed as you pointed out correctly.
Any method or workarounds you have found? I did hear about using an external camera for point cloud registration, but that seems a bit too complicated to set up and might have offset problems.
- AndrewSmigajHonored Guest
I am not sure as I haven't checked in a bit. I was hoping if they were going to continue camera restrictions that they would make an API for us to do at least image tracking through them.
I switched to ThinkReality A3s for experimental mixed reality development. I have a few really cool ideas and they actually have the capability to do image and object tracking. It is kind of a let down to miss these features as it was touted as a mixed reality device.
Putting an external camera on is a possibility but I figured a lot of users wouldn't want to have to attach an external camera. Also creates some development overhead though that isn't the end of the world. I think the Ultraleap would be a decent option as it is designed for mixed reality and has two cameras.
Quick Links
- Horizon Developer Support
- Quest User Forums
- Troubleshooting Forum for problems with a game or app
- Quest Support for problems with your device
Other Meta Support
Related Content
- 1 year ago
- 13 days ago
- 1 year ago