Creating an Object detection App Accessing Quest Pro built In camera.

6 replies
4625 views

Hi Team,

I am trying to make VR app that can detect object in the scene and do segmentation using the build in camera of the Meta Quest Pro, the platform I am using is Unity and trying to using a TensorFlow Lite model incorporated with the app do the above task. But I am not able to get the deep learning model incorporated with the Unity App for Meta Quest Pro. Can you please give some advice on how to go about this please.

This topic has been closed for replies.

S

SynergizAnswer

Inspiring

Hmmmm might not work, getting access to the cast feed itself (if Meta doesn't allow cam feed they won't allow access to cast feed), but not entirely sure

S

Synergiz

Inspiring

First, can you access Quest Pro camera feed in Unity ? I thought this was not permitted.

E

eabyAuthor

New Participant

I casted the Quest Pro to my laptop to take pictures and run object recognition code on the laptop with those images as input. So, I was thinking if we can get access to that casting feed within Unity, then we could do the same within Unity.

Do you think if that is possible?

S

SynergizAnswer

Inspiring

Hmmmm might not work, getting access to the cast feed itself (if Meta doesn't allow cam feed they won't allow access to cast feed), but not entirely sure

M

monsterbai

Participant

Can you now achieve that function? Do you know if Vision Pro can achieve object detection?

G

Gelso77

New Participant

Really interesting topics, let's suppose that it works ....the object detection returns only x and y it doesn't return the profundity (z) everything will be in 2D

jtriveri

Honored Contributor

Quest has an API for accessing an estimated depth texture
https://developer.oculus.com/documentation/native/android/mobile-depth/

Get Help

Sign up

Login with SSO

Login to the community

Login with SSO