Is it possible to scroll UI Elements that are not targeted by a Raycaster? (Oculus Go)

Hi everybody!

I want to attach UI elements to the controller anchor and scroll through them. I'm able to use the EventSystem with the OVRInputManager and the OVRRaycaster, but since the UI Elements are attached to the controller, the controller can not point at them and they are not active.

Is it possible to scroll through these UI elements with a swipe of the touchpad and make a selection with a push on the touchpad?

Thanks!