Conflict between Gaze and (controller) Pointer Oculus Go unity

I hope you can help me with this one:
I am trying to use the Oculus Go controller to interact with the UI, but Unity keeps making use of the Gaze pointer. In other words, it doesnt matter if I point at the button, I have to stare at it as well in order for the button to work. How can I solve this? Thank you so much in advance!