It is impossible to play games in VR using the Xbox controller (or any other I suppose) connected to the PC. Oculus Link automatically, without prompting or my consent, uses a controller to change controls, aka turn on head tracking, scroll the mouse...