Cannot get both hands and controllers to show up in Unity, only one or the other

I've got a basic unity project with the example "Complete XR Origin Hands Set Up" prefab. I've adjusted it to include support for both hand tracking and controllers (ie when the user is using controllers, it displays controllers. When the user has the controllers set down, it tracks hands). This all works fine and dandy in the unity preview and over airlink, but when I actually build the project and run it on my headset using oculus runtime, I run into a weird issue:

When using the "OpenXR" plugin provider with "Meta XR feature group" enabled (as seen in the image below), I am able to use hand tracking perfectly, but switching to controllers doesn't work (the controllers never show up)

When using the "Oculus" plugin provider, it's the complete opposite. I can see my controllers and they work perfectly, but hand tracking no longer functions (although I can still see the hand tracking menu icons when turning my hands over)