How to disable Black Hand Model Mesh used for hand tracking when controllers are active

We are enabling both controller input and hand tracking input, however, if the user starts our app using controllers, the black models used for hands will not be hidden. The user must then put down the controllers, engage hand tracking, then pick up controllers again to get rid of the black hand model meshes. 

How do I properly disable those black hand models meshes if a user decides to use controllers only?  (pic attached)