Forum Discussion
Solved
Creating an Object detection App Accessing Quest Pro built In camera.
Hi Team,
I am trying to make VR app that can detect object in the scene and do segmentation using the build in camera of the Meta Quest Pro, the platform I am using is Unity and trying to using a TensorFlow Lite model incorporated with the app do the above task. But I am not able to get the deep learning model incorporated with the Unity App for Meta Quest Pro. Can you please give some advice on how to go about this please.
Hmmmm might not work, getting access to the cast feed itself (if Meta doesn't allow cam feed they won't allow access to cast feed), but not entirely sure
6 Replies
Replies have been turned off for this discussion
First, can you access Quest Pro camera feed in Unity ? I thought this was not permitted.
I casted the Quest Pro to my laptop to take pictures and run object recognition code on the laptop with those images as input. So, I was thinking if we can get access to that casting feed within Unity, then we could do the same within Unity.
Do you think if that is possible?
Hmmmm might not work, getting access to the cast feed itself (if Meta doesn't allow cam feed they won't allow access to cast feed), but not entirely sure
Can you now achieve that function? Do you know if Vision Pro can achieve object detection?
Really interesting topics, let's suppose that it works ....the object detection returns only x and y it doesn't return the profundity (z) everything will be in 2D
Quest has an API for accessing an estimated depth texture
https://developer.oculus.com/documentation/native/android/mobile-depth/
