Suggestion: Allow apps to request permission to access camera feed(s)
The developer blog says: "We built Passthrough API with privacy in mind. Apps that use Passthrough API cannot access, view, or store images or videos of your physical environment from the Oculus Quest 2 sensors. This means raw images from device sensors are processed on-device." That's all well and good, but what if an application has a legitimate reason to need access to that data? I can think of several such use cases: A camera app for taking pictures/recording video in 3D Mixed reality experiences that implement computer vision algorithms to react to things in the real world A more advanced version of Waltz of the Wizard's mixed reality sandbox that allows changes to be made to objects in the real world (well, at least how they're displayed in the headset š) using image processing filters Trippy effects that go beyond the pre-existing filters in the SDK I'm sure there are many others as well. From my understanding, none of these use cases are currently possible on the Quest, even though there's no reason they shouldn't be with the hardware that's present. I couldn't even code it for my own experimentation unless I find some way to root the headset, which is annoying as I spent $1,500 on a Quest Pro and shouldn't be prevented from using its hardware as I please. So what I recommend is adding an API for accessing this raw image data, which would of course only work if the user grants permission to the app. Apps can already do this on smartphones with no issues, so I don't see how the Quest would be any different. The Oculus Store, of course, can also set policies as necessary, such as requiring apps to keep the image data on device whenever possible, and to never send it to a remote server without the user explicitly giving permission. I'd have posted this in the SDK Feedback section, but for some reason it says I'm not allowed to start a thread there, so I'm posting it here instead.
Disable guardian at runtime in Mixed Reality Apps (Unity)
Hi! I'm in the process of creating a mixed reality app that integrates both passthrough functionality and the Scene API. Despite conducting a full room scan and navigating around, the guardian system continues to restrict the app. I'm searching for a way to programmatically deactivate the guardian system, either in Unreal or Unity. Considering that Meta's "First Encounter" demo doesn't encounter these boundary issues, I'm convinced there must be a way to resolve this. Thank u!
Applying a LUT on quest pro color passthrough
Working on a mixed reality experience at the moment and trying to get a color LUT on the OVR layer to edit the mood of the color passthrough on quest pro. I've made several different LUT's trying a range of different compression and build settings using meta's documentation. https://developer.oculus.com/documentation/unity/unity-passthrough-creating-color-luts/ https://developer.oculus.com/documentation/unity/unity-passthrough-neutral-color-luts/ Compression Settings Extra Details Unity 2022.3.5f1 Graphics - Vulkan Color Gamut - sRGB Haven't been able to see the effect of the LUT come through on the color passthrough. Understand it's an experimental feature so maybe a little bit untested but curious if anyone has had success in making them work ?? Is there a simple step / setting I'm missing?Windows Volumetric Apps on Meta Quest announced for Developers
Microsoft announced Volumetric Windows apps are coming to Meta Quest at Build today. If i'm understanding it correctly, it looks like Developers that currently have mixed reality Windows apps or 3D objects can extend interaction to the Meta Quest from their Windows machine or Windows 365 via a new volumetric API. The screenshots show several virtual application windows open, with a 3D Xbox controller model being handled by the user and dismantled virtually. This is the sign up for the developer preview: https://aka.ms/VolumetricApps Video demo: https://x.com/SadlyItsBradley/status/1792974464424317307 Meta & Microsoft: The Future of Mixed Reality and Productivity - Developer session at Microsoft Build 2024 https://www.youtube.com/watch?v=ev3vsv5fdrE Creating Immersive 3D Solutions with Microsoft Mesh - Developer session at Microsoft Build 2024 https://www.youtube.com/watch?v=Q5LUtwjobgA Build Day 1 : https://www.youtube.com/live/2bnayWpTpW8 Build Day 2: https://www.youtube.com/live/FwJ1Zz_DntY Build Day 3: https://www.youtube.com/live/8Zy9QtZ6czE Bring Your Mobile Apps to Meta Horizon OS Developer Sign up https://developers.facebook.com/m/spatial-app-framework/ Sources and further details https://blogs.windows.com/windowsdeveloper/2024/05/21/unlock-a-new-era-of-innovation-with-windows-copilot-runtime-and-copilot-pcs/ https://www.meta.com/en-gb/blog/quest/meta-horizon-os-open-hardware-ecosystem-asus-republic-gamers-lenovo-xbox/ https://www.roadtovr.com/microsoft-meta-windows-3d-apps-quest/ https://www.uploadvr.com/microsoft-windows-volumetric-apps-quest/ https://www.techopedia.com/news/microsoft-extends-windows-apps-in-3d-on-metas-quest-headset https://www.digitaltrends.com/computing/microsoft-windows-volumetric-apps-coming-to-meta-quest-3 https://techcrunch.com/2024/05/21/microsofts-new-volumetric-apps-for-quest-headsets-extend-windows-apps-into-the-3d-space https://www.theverge.com/2024/5/21/24161817/microsoft-windows-volumetric-apps-meta-quest-api
[solved] AR Passthrough - Bouncing Ball Template - Dropped Balls Not Reacting to my Scene Setup
Expected = Squeeze the right hand trigger to create and release a ball. Notice that the ball bounces against your defined surfaces. Problem - I've completed my room setup on a Quest Pro and followed instruction for the Bouncing Ball Scene Sample (linked below), and it looks visually correct, however the balls fall through my floor and scene recognized objects when I expect them to stop the balls from falling by creating 2d planes and 3D volumes which the ball would collide with. Can anyone help me understand where I'm off (bouncing them) please? Thank you! Solution - When using Scene in your project it's required to enable its capability in the project config. Ref: https://developer.oculus.com/documentation/unity/unity-scene-bouncing-ball-sample/
Oculus Spatial Anchor drifts in the Passthrough space
Iām trying to spawn a Cube as spatial anchor. But after spawning it drifts if I move physically. Iām add OVRSpatialAnchor after instantiating like this, _cube.AddComponent<OVRSpatialAnchor>(); Please correct me if I have to check something on the build settings or some Oculus settings in Unity. Thanks guys!
