Mixed Reality Capture Tools (2.0) not working on Quest and test app crashes to ~1fps

[rib]

Hi, I'm trying to set up the Mixed Reality Capture Tools to be able to record a demo with the Oculus Quest. I've managed to calibrate a USB camera and uploaded the config onto the device under my app's files/ directory and I have OBS set up with the 'Oculus MRC' fg/bg sources as documented. I can connect to the device via OBS once I start my application but when I do I seem to just get one frame grabbed by OBS and the app framerate suddenly drops down to about one frame per second, with no visible updates in OBS beyond the first frame.

I wonder if anyone else had any luck using the latest Mixed Reality Capture tools (Oculus_MRC_Tools_2.0/1.41.0_RC1, OBS 23.2.1, Unity Integration Asset 1.40) and can maybe give some hints for what I might need to do to get it working?

[XRAl]

rib said:

Thanks, it's a good overview of the technology and the setup process, though I think, afaikt, I did everything as described.

One thing that caused me some trouble for a while was that I was using OBS 24.x.x to start with and it turns out that the current plugin binaries are tied to the OBS 23.x.x ABI which wasn't immediately obvious.

Thank you! I was struggling for a while with 24.x not seeing the Oculus MRC camera. Seems like the official docs should clearly state the version needed.

[Lazius001]

Well until developpers integrated Oculus MRC, then I think its best, as a content creator for me to wait until the Oculus Link update is out in November then we can integrate with Steam as LIV is still working on wireless solutions and Mixcast also don't have wireless for now..

Oculus Demo also showed Bestsaber on quest mrc, so not sure...

I'll ask Oculus list of titles available, and see if we can share it as I can't find online.

Thx for the replies, clarified all points.

[XRAl]

Yeah in the OC6 session they mention they are "working with" Beat Saber, Dead And buried 2 and super hot



I tried copying my camera xml config to the com.beatgames.beatsaber/files location and it doesnt connect with OBS Studio and i ran a port scanner on there and also my own built app and can not even see the port listening and when running the below adb command for beatsaber I can clearly see its not implemented yet as it doesnt even try to start the camera capture in the app.

When i check to see if its running on my own app I get:

./adb logcat -s OVRPlugin

10-02 15:11:36.036 19860 19884 I OVRPlugin: [MediaManager] MRC camera found

10-02 15:11:36.036 19860 19884 I OVRPlugin: [MediaManager] MrcConfig: enabled 1 hq_mode 0, frame 2560 x 1080 image 1920 x 1080 tcp_port 28734 debugcamera 0 bitrate 8000000

10-02 15:11:36.036 19860 19884 I OVRPlugin: [MediaManager] Listening at 0.0.0.0 tcp_port 28734

10-02 15:11:36.074 19860 19884 D OVRPlugin: [MediaManager] SetMrcActivationMode 0 listening 1

10-02 15:11:36.817 19860 19884 I OVRPlugin: [MediaManager] deconstruct

10-02 15:11:36.817 19860 19884 I OVRPlugin: [MediaManager] Listening stopped

10-02 15:11:43.076 19860 19908 D OVRPlugin: Leaving VR mode.

10-02 15:11:43.638 19860 19908 D OVRPlugin: Unregistering utility receivers.

[osxiaoyu]

About Mixed Reality Capture Tools, only one program of skybox vr can be recognized in obs. Other applications cannot be recognized. How should I operate?

[petergraham]

Today I tried for scene composition of MixedRealityCapture in OBS. I have been using a 1920 * 1080 resolution monitor for it. In OBS the output I get from sources like foreground, background and video capture I wasn't able to resize them without getting the output cropped/cut. On a 4K monitor, I am getting output as expected. Am I missing any option to resize the sources without getting the output cropped ?

[Linsomont]

Thanks for sharing your views. I was looking for the answer to this question too and you guys provided me with some good ones. Thank you very much.