Are Oculus achievements supposed to show their icon and description when unlocked in-game?

I am in the final stages of getting achievements setup for our VR game. 

I have gotten achievements to unlock properly, and can successfully query them using blueprint. However, when they unlock, it shows a generic star badge in the headset, but not the icon/title/description as set in the Oculus app configuration. They do however show up in my Oculus home as unlocked afterwords. 

Is this intended behavior?
Do I have to have my app published first for this to work?
Do I have to manually make an achievement overlay system in Unreal?


When running through SteamVR using Steam Achievements, they unlock and appear with the badge and title. I am trying to get the same functionality from Oculus.