World Space UI judder/Floating issues??

Ok so I have a SmarthWatch attached to my Players arm, i'm using it for my Health bar. So when you look at your watch you can see your health. Anyway, When i'm looking at my Health Bar, which is on a Canvas, and I move my head around, the Health bar floats around, almost as if it has a smooth look on it. Its very annoying and I need to it be "fixed/Stuck" to the screen of the watch instead. My canvas is a child of the watch. When I move my Mouse around, it does not cause that judder floating UI issue. Only when I move my head with the Headset. I know that when I move my head with the HMD it only rotates the MainCamera, not the Player controller, when I just the Mouse or Xbox Controller, it rotates the Player controller.... Not sure if this would cause the UI judder issue??