Skip to main content
ttaw
New Participant
February 3, 2024

How to obtain the camera image of Quest3 in UE on PC while streaming

    I am working on an object recognition function that requires real-time acquisition of the Quest3 camera image on the PC during runtime and transmission to my object recognition engine on the PC. I searched for some information online, and some posts said that it is impossible to achieve this, but I found a developer option on the Oculus PC application that can obtain camera images on the computer through passthrough over link. It seems that this can be achieved, but I don't know how to call it.

    I am using Quest3, wired streaming, win11x64, ue5.3.2, the latest version of the metaXR plugin.

    This topic has been closed for replies.

    2 replies

    Aeromixx635612
    Aeromixx635612
    Inspiring
    February 4, 2024

    This option you show will allow you to use and test passthrough on PC with the MetaXR plugin in Unreal. (Major Note: opaque materials do not show up, this is a bug, in standalone, they will show up.)

    Actually getting picture/video/data from the headset cameras is in fact blocked by the current framework. Would be cool if they reverse this decision one day or create pipelines to pass certain parameters through, such as QR Codes.

    ttawAuthor
    New Participant
    February 4, 2024

    OK, i got it. Thank you.

    Terms & ConditionsAccessibility statement