CPU level not increasing fast enough

Hi, I noticed that the Dynamic Clock Throttling is sometimes not fast enough to react to the CPU performance demand and even lowers the CPU level when it shouldn't. If I put the headset to sleep and wake up the headset after a few seconds I will have a few seconds where the FPS will be around 36 while the CPU and GPU levels are both on 0. And only after a few seconds(3s to 25s) does the level increase to match the performance required.

If you have any solutions please let me know.

I tried setting the CPU and GPU levels to 3 on application focus which solves the problem until I remove the high level and then Dynamic Clock Throttling will lower the CPU level to zero which causes the PFS to drop to 36 until it re increases the level up to match what's needed.

I have attached a photo of what happening where the blue arrow is where I get the low FPS drop due to CPU level being 0( on this screenshot it only happens for a few second because of me taking a picture but normally happen for much longer).

Background: