Unity play mode does not start game in VR

I am started developing in Unity, and try to run my game in VR. SO I take on my Quest 3, start Quest Link (or AirLink) and switch to Monitor1 (i have 2 of them).
I have installed XR Plugin Management, Oculus Plugin, set Android settings in XR Plugin Management to Oculus, same with windows settings. Also set basic interactions, with hand and etc. 
When I build and upload it in Quest3, the whole process works fine, i can look around, i can move the raycaster attached to my hands etc.

But when I press Play button in Unity Editor, at first it starts my game in Quest 3, as it is supposed to be. 
When i go back to editor, make any changes, and tries to play again my headset start flashing like a stroboscope for at least 10 seconds, and fallbacks to playing my game in the editor (through Quest link, in VR, but not 3D) instead of starting the actual game. 
Previously it returned with an error: 
"Failed to set DeveloperMode on Start.
UnityEngine.Debug:LogError (object)
Unity.XR.Oculus.Development:OverrideDeveloperModeStart ()"

But recently it won't even show this error, just does not do what it should.
It's quiet annoying, as building or patching game every time is time consuming, and I'd really like to use play button for development. 

Is anyone experienced this before? Is there any solution for this?