Space sharing with EnableWorldLock = true drifts the controller pose

I am using the meta MRUK sdk to share the scene space between an host and a gust user with the EnableWorldLock = true.

After the scene is shared, the guest's right/left controller pose is slightly misaligned. I tried to convert from local space to unity or room space but it did not work to realign the pose.

Did anyone have the same issue?
Thanks for any help