Quest/Quest2 with OpenCV?

I'm looking to build an application that maps your environment automatically using an external OAK-D camera attached to the headset.

Has anyone managed to integrate something similar?

Any help with integrating OpenCV with the Quest would be a huge help.