Grabbed objects in Meta Interaction SDK move slightly ahead of the controller in Unity

Hello there!

I would start with checking the collision interaction between the object and your controller collider. If you use IgnoreCollision, you can make it so the colliders cannot interact with one another. You could also achieve this by creating different layers for your grabbable objects and your collisions. 

You may also want to look into Fixed Timestep if you have not already. This is a good tool for dictating when you want physics calculations to be performed. If you have already set that up, it may be the Interpolate causing the issue by making sure the distance at which the pose the Rigidbody applies is distanced enough from your controller. 

Any additional information you can share on resolutions you've attempted, or techniques you've used, would be greatly appreciated. 

If neither of these resolved this, let me know so we may troubleshoot further!

Thanks a lot for the detailed suggestions! 🙏

I’ve gone through all of the options you mentioned:

- I checked the controller colliders and set up a separate Controller layer to ignore collisions with my Grabbable objects. 
- I experimented with the Fixed Timestep values (down to 0.01) to increase physics update frequency.

- I also tested different Rigidbody interpolation modes (None, Interpolate, Extrapolate).

Unfortunately, none of these changes solved the issue.

To rule out problems with my own project setup, I also created a completely new project and followed Meta’s Hello World tutorial (link). Even in that clean setup, the grabbed ball still appears to move slightly ahead of the controller, as if the controller is lagging behind.

So it seems like this behavior is happening even in the most basic Interaction SDK sample.

Do you know if this is expected behavior in the SDK, or if there’s another setting I might have missed that controls how tightly a grabbed object follows the controller?

For reference: I've opened up another thread in the unity discussion board, where I also uploaded a video to showcase the problem, you might want to look into that: https://discussions.unity.com/t/grabbed-objects-in-meta-interaction-sdk-move-slightly-ahead-of-the-controller-in-unity/1685287

Sidenote: In the video it looks kind of extreme, i think thats caused by the recorder, its not that extreme in the usual case