Swapping two snap interactors

Hi ! I'm working on a game where the player can grab objects and snap them to slots, and I can't find a way to implement a system where you could basically swap to objects from their respective slots. Let me give you an example.

ObjectA is snapped to SlotA, and ObjectB to SlotB. Currently, if I grab ObjectA and try to snap it to SlotB, it won't work because there's already a SnapInteractor (ObjectB) attached to SlotB. (btw I know you can increase the amount of interactors, but it only results in the two objects being snapped to the same slot which is not what I want)

What i'd like it to do instead is : When releasing ObjectA on SlotB, it snaps it correctly, and ObjectB is now snapped to SlotA as well. Also it's important to me that we use Snap interactions - even with modifications - than a fully custom solution, which we already have.