Player Movement with Joystick Rotation

When using the Oculus SDK OvrPlayerController prefab I have been having an interesting problem with the player rotating when I use the joystick. Basically if a player stands in place and tries to rotate the camera by using the right joystick the entire player physically moves with the camera rotation. Essentially the player moves in a somewhat large circle which means that any rotation near and object leads to a collision with that object. I tried starting a fresh project and this still occurred with just the player controller prefab in a scene/ If anyone could help me eliminate this problem that would be great. Thanks!