Random vulkan GPU crashes on standalone Quest 3 build. "Trying to write to freed GPU memory"

I have tried to figure out why my Quest 3 build crashes randomly in between 5 - 60 seconds
I ran a lot of log files through chatGPT and it seems to me that the GPU/vulkan is crashing
No issues on Windows
Here is a summary of the issue:

• "Vulkan GPU Memory Issue → Your crash log shows "vk_devicememory" was already freed, meaning Vulkan is trying to write to freed GPU memory"
  
• GPU Page Fault (Invalid Access) → The Quest Adreno GPU crashes when Unreal tries to access invalid memory, possibly from textures, shaders, or vertex buffers being released too early.
• Random Timing Suggests Asynchronous Issue → Since crashes happen randomly (5s, 20s, 2min), it could be multithreading-related, where one thread frees GPU memory while another is still using it.
  

This shows up a lot
03-22 23:43:51.717 0 0 E kgsl-3d0: ---- premature free ----
03-22 23:43:51.717 0 0 E kgsl-3d0: [4002730000-4002819000] (vk_devicememory) was already freed by pid 23459

And this
03-22 23:15:36.890 0 0 F kgsl-3d0: GPU PAGE FAULT: addr = 401C560000 pid= 10788 name=mpany.ProjectVR drawctxt=405504 context pid = 0
And chatGPT says

• This means that the GPU is trying to access an invalid memory address (write permission fault).

• Faulting block: CP (Command Processor), indicating shader or rendering pipeline issues