Orientation flipping when using quest link.

I just got a link cable and I have only had this problem when I started using quest link. My orientation keeps flipping backwards randomly when I play games. It will do this several times and then it will be fine for a while before repeating the process. I have fresh batteries and I cleaned off the sensors, so I do not know why this is happening.