Ray Interactable Canvas and Scroll View: Scroll does not work

Hi, I am using Unity 6 and Meta XR All in one package v71

I used CurvedUnityCanvas prefab in my scene, then did right-click -> Interaction SDK -> Add Ray Interaction to Canvas.
Everything works, I can indeed see the selector and small rays coming out of my hands (not controllers). However, I can't scroll through the scroll view neither by ray interacting nor by poke interaction.

Is there any way to fix this issue?