Oculus Rift S Run in Background not working?

Hello,

If i remove and keep the oculus rift s headset aside while the Unity player (64-bit) is running and wear the headset again after 20-25 minutes, i only see a black screen with gaze-pointer and the whole Unity freezes. It takes 5 minutes or sometimes 10 minutes for the Oculus Rift S to go into resume mode. How do I fix this? I even wrote a script for running the app in background, it runs well but when I wear the HMD again, then it goes into freeze mode.