Passthrough over Quest Link only works occasionally

I have an issue where when testing a passthrough app over Link in Unity Play Mode (using Oculus/Meta SDK, not OpenXR), I get a black screen instead of passthrough. Passthrough often works the first time after connecting the headset or restarting the editor. Subsequent play modes however produce black screen (the app works fine, but just passthrough is broke). This is on Quest Pro, I haven't been able to test the issue on other hardware. I am pretty sure all the settings are properly set up, have followed the docs closely. The built APK always works fine. Anyone else had this issue and solved it? Any help appreciated as it really is a bummer not to be able to test passthrough in editor.