Apple just announced the VisionOS 2.0 at WWDC 2024, which now gives enterprise users/apps raw camera access and other similar features (note that enterprise users must first send Apple a request access to access the new API). For the app to get access to the camera feed features, the user must accept the required access (i.e. camera access), similar to how mobile apps today request further access from user devices.
From Apple's website (https://developer.apple.com/visionos/😞
"
Enterprise APIs
New APIs for visionOS grant enhanced sensor access and increased control, so you can create more powerful enterprise solutions and spatial experiences. Access the main camera, spatial barcode and QR code scanning, the Apple Neural Engine, and more."
Video Explaining the new camera access features: https://developer.apple.com/videos/play/wwdc2024/10139/
API Documentation: https://developer.apple.com/documentation/visionOS/building-spatial-experiences-for-business-apps-with-enterprise-apis
This is a great solution for industry uses. Maybe this may come to consumer apps in the future as well, but for now, this is already a great way to get started working on AR applications. A lot of this seems like ideas from the HoloLens, Magic Leap, and Vuzix devices, which is great as they have had some good uses in the past. Hopefully this will push Meta to do something similar for their headsets, even if only for the Quest Pro or a similar industry tailored headset, which may still require an industry request.
Ivan_aa Apple made a solid step forward and Meta has to do the same if they don't want to stay back on the XR race
I hope it is a matter of time that Meta allows raw camera access in every device. Not just quest pro.
For now, the apple thing is only meant to be used in enterprise products and with previous authorization. I would like everyone to have access in the case of Meta.
