OVRRaycaster does not consider Raycast Padding
The OVRRaycaster script only uses the Rect Transform of the UI element to perform ray casting and does not take Raycast Padding into consideration.
If anyone has a quick fix for this, I'd love to hear about it!