Passthrough camera data is not available on Quest 3 developing with Unity
Basically it is not possible to access the real time passthrough video from Quest 3 in Unity. Many devs among the internet think it is a crucial feature to be able to process to create incredible mixed reality apps with object recognition using machine learning. Nevertheless, it is not possible to access the real time video captured by quest 3 in unity. Here is a reddit post made by me where people are requesting this feature. Please, we need access to real time passthrough video in Unity or other engines.
guide to playing videos
the two folders i had to create (Movies, 3D); - Computer\Samsung Galaxy S7\Phone\Oculus\Movies - Computer\Samsung Galaxy S7\Phone\Oculus\Movies\3D 2d, 360, 180, videos go into the Movies folder. 360 degree videos have to end in _360, before the file extension; "name_360.mp4" 180 degree videos have to end in _180, before the file extension; "name_180.mp4" 3d side by side videos go into the 3D folder, but the name has to end in _LR the _LR is at the end of the name and before the file extension, "name_LR.mp4." for 360 degree videos that are in top bottom format, that looks like two layered pictures, you rename them "name_TB_360.mp4" these go into the movies folder too. you need to download a app from the oculus app to play the videos, its called "oculus video". if you dl a video from the samsumg vr app or the oculus video app its not going to be stored in the movies folder. you need to search your phone for the .mp4 file to find the files then move them to the movies folder, renaming them so oculus video can play them. if your encoding a 3d sbs video, you want to have half horizontal, and use 720p resolution, thats 640x720 for the left eye and 640x720 for the right eye. videos wont play without sound 48000 hz works.
