Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
ttaw's avatar
ttaw
Honored Guest
1 year ago

How to obtain the camera image of Quest3 in UE on PC while streaming

    I am working on an object recognition function that requires real-time acquisition of the Quest3 camera image on the PC during runtime and transmission to my object recognition engine on the PC. I searched for some information online, and some posts said that it is impossible to achieve this, but I found a developer option on the Oculus PC application that can obtain camera images on the computer through passthrough over link. It seems that this can be achieved, but I don't know how to call it.

    I am using Quest3, wired streaming, win11x64, ue5.3.2, the latest version of the metaXR plugin.

2 Replies

Replies have been turned off for this discussion
  • Aeromixx's avatar
    Aeromixx
    Expert Protege

    This option you show will allow you to use and test passthrough on PC with the MetaXR plugin in Unreal. (Major Note: opaque materials do not show up, this is a bug, in standalone, they will show up.)

    Actually getting picture/video/data from the headset cameras is in fact blocked by the current framework. Would be cool if they reverse this decision one day or create pipelines to pass certain parameters through, such as QR Codes.

    • ttaw's avatar
      ttaw
      Honored Guest

      OK, i got it. Thank you.