In Unreal there is a built in node "Get Screen Location to World Space" that does what you want but I'm not sure how it behaves in a Quest which has 2 offsetted displays for each eye.
Also Ditto. How can we build true mixed reality apps if we cant compute the real world data. Frustrating...
Meta already relented and said they are planning to give some level of developer access to the cameras. I would expect to see it sometime later this year.
Fantastic news to see it finally arriving! I may have to wait to play with it though - part of this process is to manually add the permission to the android manifest file. Because of the way that Unity handles the android manifest, I've never been able to find good documentation on how to do this - I add the permission, but it's always removed when building the APK. Anyone know what I might be doing wrong or have a step-by-step guide I can check out? Plus - if the device will only allow one attempt to set the permission (as xrdevbob suggests) - I'm sure I'll mess it up, and have to factory reset a bunch of times. 🙂
Don't worry, the manifest should not change if you don't update it. There is a Meta option to update the Manifest as well as create a store compatible manifest. I would just do this once and then add the camera permission manually. Once you've done this the manifest does not just change by itself.
Also for the camera permissions, this only happens if you deny all the permissions. But even then, all you have to do is to create a new build (incremental is fine). You do not have to factory reset your device.
Feel free to ping again if you get stuck with anything!
Sorry to ask, but I've tried those things in the past, and it didn't work for me - my changes kept getting overwritten. Could you give me the actual steps involved?
