Moving Oculus controller back and forth(along the z axis)

Hey,
I have written a script to pick an object with a rigidbody component by the ray casted from the controller and move it around. 
I parent the object to the controller to move it in the scene then. However, I can not move neither the controller nor the object in the forward or backward direction. I can move it up and down or in a circle but I also want to move it along the z axis. 

If anyone could point me in a right direction or help me with this, I would greatly appreciate it!

Thanks in advance.