Forum Discussion
Developing a PC Mixed Reality App with Quest 3 Passthrough
Hello everyone, I am facing an issue with the passthrough mode on the Meta Quest 3 using Unity (version 2022.3) with the Quest Link feature. I am seeking advice or feedback on this matter. I've dev...
Hi, have you managed to get anywhere with this? I currently have it working with a cable but not airlink.
Hello,
I tried using the cable, the latency is less noticeable, but it is only for debugging purposes. I really wanted to develop a mixed reality application that runs on a PC and get the rendering in the headset through airlink. It's really a shame that mixed reality applications are exclusively reserved for Android applications running natively in the Quest environment.
Hi, we've come to the same conclusion.. I think the bottleneck is sending the video feed from the headset to the PC and then back to the headset and also openXR haven't really created a passthrough package, so you have to use it with the Meta SDK. Hopefully they'll sort this in the near future..
Hi, it may not be necessary to send the full video feed. Instead it would be more valuable to send the data from the depth sensors in the form of a 3D model of the surroundings IRL, and maybe an image from the video feed from time to time if needed. The pc needs only to send the rendered 3D content frames. The headset "only" has to show these frames like an overlay on top of the video feed.
Don't know if this is possible or will be in the future though ^^
