MR Quest 3 app question for parsing images from camera
Hi, fairly new to working with Unity and certainly new to working with it for developing VR/MR apps, but I wanted to dip my toe in the water with a VERY simple, almost proof of concept app that would work on the quest 3, and I'm running into a MOUNTAIN of trouble. I tried using meta AI to help fill in the gaps, but as I'm sure we all know it's very limited in the help it can give. The short version is that I want to make an MR app that can look at surfaces like walls and tables, and detect a color on them. Let's say if I take a laser pointer and draw a quick line, I want to be able to see that red light on the surface, and have the app react to it. I've gone through some startup tutorials, and I have a very basic app that pulls surface data, but the "reading color from the camera" part is proving to be exceedingly difficult to even get started on. From what I understand, I needed to attach a script to the main camera object that would take an image from the camera on the "update" function, parse through it looking for whatever color I choose, and then store the location on the surface where it found it (and then draw a line there or something in MR or apply a texture). I've been told that you can't really pull full raw camera data, because Meta hasn't worked out the kinks yet and thinks there's a privacy issue even if the entire app is local and all the data is processed without sending anything out to the internet, however supposedly I should be able to just pull lots of individual camera screenshots on every "update" call to get this done. Any ideas from you more experienced developers out there? Did I pick some massively difficult thing to do as a beginner MR app?Solved1.9KViews0likes5Comments