If you are experiencing an issue where you can't get out of passthrough after removing your headset, The solution I found was disabling passthrough all together. Currently, passthrough seems bugged. At least if you are using it with Oculus/Meta link....