Maintain center orientation between scenes

I have 3 scenes in my game, each use the oculus camera prefab. When switching from one scene to another, it seems that the center orientation of the headset is reset to where ever the HMD is pointing during the transition between scenes. This is an issue because if a user turns their head to the left or right during the transition, then that direction is now considered to be the center and the orientation needs to be reset manually.

How can I save the center orientation between scenes?

PS. I tried to search on this but only found a post from 2013 which didn't have a solution :(