Forum Discussion
Passthrough API WebCamTexture Does Not Render Unity GameObjects
When using the passthrough API, you can send a feed of the headset's camera via the WebcamTexture or alternatively, the Android API. I want to have GameObjects rendered in this view however, such tha...
Hello! From what I know about the Passthrough Camera API, it can only provide the raw camera feed from the Quest's RGB Passthrough cameras. You could use the Android MediaProjection API to get what is being drawn on the Quest's displays, similar to the video feed you get from casting. There is GitHub project that demos this feature: hsratneshsci/Quest-Camera-access
The disadvantage with this method is that everything that is drawn on the display will be viewable in the feed, and there's no way of excluding specific objects from it. If you're using the Passthrough Camera API, maybe you could have a custom shader that draws your GameObjects onto the WebCamTexture? You could also interface with the native Camera2 API in Unity to get the feeds of both the RGB cameras, which is not possible with Unity's WebCamTexture, and use them to estimate stereo vision. I have also developed an open source plugin on GitHub that allows you to do so, so maybe it can help you out 😄
Uralstech/UXR.QuestCamera