SetBasePosition not updating controllers location?

I've been struggling with getting world origin to be consistent between Oculus VR and Steam VR.  My Pawn (UE4) is a sphere about the size of a head.  There is a scene component attached to that as a padding and a camera attached to that.  My touch controllers are attached to the scene comp. The trouble came from steam VR pushing my camera up.  So I started using GEngine->XRSystem->SetBasePosition to offset the origin that way my camera doesn't get pushed up outside of the parent sphere.  Unfortunately in doing this I've noticed that my touch controllers are not following the update.  For a brief moment before my code kicks in Steam VR does have the camera moved up and out of the sphere - then my update comes in and adjusts everything and makes it good, except it seems the touch controllers do not follow in this update.  I've had the locations both relative and world print to screen for the sphere,  the scene, and the camera comps.  It's easy to test as they are all supposed to be Zero (the camera of course is moving around as it tracks near zero) .

So what is going on?  Is there a way to update whatever is causing the controllers to ignore this SetBase upsate?