MetaAvatars not persistent

I'm facing an issue in Unity VR. MetaAvatar loads in the main scene but when I change the scene (either by simple Load or using LoadAsync) the avatar doesn't load in the next scene and when I come back to the main scene it again doesn't load the MetaAvatar. Is there any way to tackle it?
Also when it loads the first time and the user goes in inactive state and wears the headset again, the MetaAvatar still doesn't loads up again.