Unity + OpenXR + OVRSpatialAnchor + Passthrough = Wobbly models

Previously we were using the Oculus XR Plugin with OVRSpatialAnchors and passthrough and all was working as intended. We needed to switch from the Oculus XR Plugin to OpenXR (for a separate package) and managed to get everything working except for when we put an OVRSpatialAnchor on a model with passthrough active, the model appears to be very wobbly compared to it's intended stable state. Once the spatial anchor has been removed off the model it appears much more stable but obviously doesn't have the other characteristics of having a spatial anchor that we need.

Does anyone know how to fix this? I saw this post with a similar issue and I updated the AndroidManifest.xml via the Oculus tools menu but that did not seem to fix it.

Potentially relevant details:

• Unity 2020.3.36
• MRTK v2.7.2
• OpenXR plugin v1.5.3
• Oculus XR plugin v1.12.0
• Oculus Integration v53.1
• Minimum Android API Level: Android 10 (API level 29)
• OpenXR settings:
  • Render mode: Single Pass Instanced/Multi-view
  • Depth Submission Mode: Depth 16 Bit
  • Interaction Profiles: Oculus Touch Controller Profile
  • OpenXR Feature Groups:
    • Hand Tracking
    • MetaXR Feature
    • Oculus Quest Support

I have tried turning off passthrough and saw that the models became stable again but that is not acceptable. I tried updating the AndroidManifest.xml as stated in the linked post but that did not change anything. My code hasn't changed going from the Oculus XR Plugin to the OpenXR Plugin but it can be summed up to just adding the OVRSpatialAnchor component:

model.AddComponent<OVRSpatialAnchor>();