For me, this often happens after a 30+ minute session of Beat Saber. I wonder if it's thermal-related: something is overloaded, and it throws the device back to Home, to give it a few seconds to cool off.
Happens to me as well. Apps close and I go to the main home screen at least 4 times in an hour. When I go back to the game its still running just fine where I left it..