Left hand Touch just pushes things around.

I have a strange problem with the prefabs that come with the AvatarWithGrab example in the Unity Utilities package. If I run the sample scene everything works great but if i pull the prefabs used for grabbing objects into a scene I create the left hand touch will not pick up objects. It only pushes them around. Strangely if I pick up an object with my right hand I can then grab it with my left. 

Any ideas on how to fix this would be greatly appreciated.

Thank you