Forum Discussion
Is it possible to access the passthrough camera feed programmatically on the Rift S?
I know that the feeds are only b/w and they are full of random artifacts, but it would still be convenient if I could use them for an OpenCV program running in my VR app. Is this possible with the Ocu...
Now it is possible to enable passthrough in Unity, there is an excellent tutorial on the official webpage: https://developer.oculus.com/documentation/unity/unity-passthrough/?locale=es_ES
But for now (and it seems that it will be forever), the only thing you can do is underlay or overlay the camera projection. The images cannot be touched/accessed from the code. It is neither possible to post-process them because the overlay/underlay are combined in a safe and separate stage by the compositor (As far as I understood). At least for the Quest 2 devices.
What I am not 100% sure about is, and it is the reason why I reached this post, if it is possible to access/postprocess the images using the Oculus Rift S. I did it with Valve Index headset using SteamVR and OpenVR SDK. Oculus Rift is stated to be compatible with SteamVR, but I don't know if the passthrough is hindered somewhere in the low-level driver.
Any update on this by mid-2022?
UPDATE:
Sadly, it seems that passthrough won't work on Oculus Rift https://forums.oculusvr.com/t5/Unity-VR-Development/When-will-the-passthrough-v31-SDK-be-available-for-Unity/m-p/880516/highlight/true#M19770