HMD keeps tracking when paused

I just updated all unity plugins to the latest version (1.16) and unity to 5.6.2p2 and i've noticed that tracking continues even when my application is paused. This also happens when calling VRSettings.enabled = false;
The image inside the rift is paused, but the player window and editor continue to update positions

This is a bit of a problem for debugging purposes so any info would be appreciated, thanks!