Basically it is not possible to access the real time passthrough video from Quest 3 in Unity.
Many devs among the internet think it is a crucial feature to be able to process to create incredible mixed reality apps with object recognition using machine learning. Nevertheless, it is not possible to access the real time video captured by quest 3 in unity.
Here is a reddit post made by me where people are requesting this feature.
Please, we need access to real time passthrough video in Unity or other engines.
I think I am right when I say: everyone agree with you.
I hope they hear all this comments and take these ideas into consideration to release passthrough camera access.
If not, I honestly do not find much interest to develop apps for quest 3. In fact I would even fail to see why quest 3 could be useful as a mixed reality device.
maybe they are afraid that developers can put malwares links to download to the headset. If they just allow to scan a QR code and something triggers inside the app (not connecting to the web) or make a pop up in the start of the game to be cautious about external links, that would be already very helpful. I hope they enable that soon, the possibilites are great
As far as I'm concerned, it is more a matter of privacy as they say in the docs. Nevertheless, as you said, asking for permission to the user should solve the problem.
I understand that is 100% a matter of privacy. I was developing for the HTC Elite headset a few months ago and was attempting the same project on their device. On their forums, an actual HTC employee stated it was available for a certain amount of time until corporate partners requested increased privacy.
It's very reasonable to do so; I do not want my headset camera to be accessed without permission, however I am sure that Oculus can construct a secure API.
I imagine you could place four framing edges at the corners of the screen to emphasize this frame-usage even more than the red recording dot. I know Meta has some great UX designers - they can communicate this information very clearly in combination with acknowledgements.
exactly - i got excited by the MR capabilities enough to start trying to learn development cause id like some MR tools that don't exist. Only to find out that Meta doesn't appear to want folks to actually develop for the headset, at least based on the state of the docs.
