Meta Avatar Hands lost tracking

I made an Unity VR project using the Oculus Integration plugin and the OVR Avatar2 sdk.
Sometimes, in build, the hands/arms of the avatar puppet don't follow the controllers pose.
The controller still work, because it's possible pointing, teleporting, but the hands remain dandling, down, aside the body. Only the hands are affected by that, the head still works fine.
I am not using the hand tracking, but only the controllers. 

Anyone had same issue?