Forum Discussion
When will we get object and image classification (Computer Vision) for Quest 3 and Quest Pro?
If I wanted to build a Mixed Reality app that can detect when a certain brand logo is visible on a poster, coffee cup coaster, etc... and then allow spatial anchoring relative to that logo there seem...
I don't know if this is relevant, but Apple bought many years ago a company called Metaio, which had an AR SDK at the time that competed against Vuforia and ARToolkit.
Metaio allowed for image (fiducial marker) and 3D object detection and tracking (moving 3D objects not just static placement).
Here is a video as an example from about 10 years ago, there are probably many more videos online.
https://m.youtube.com/watch?v=m73gJGdiTik&pp=ygUWTWV0YWlvIG9iamVjdCB0cmFja2luZw%3D%3D
I can only imagine that Apple may integrate Metaio's old software into Apple Vision Pro someday (hopefully improved after all of these years), and I hope this pushes Meta to integrate it into the Quest as well, least into the Quest Pro, to allow for better tools for developers to develop AR applications.
Thank you for your update, I believe apple and Meta will allow us to do Object detection in the near future.
Keep in mind, neither company will grant access to the raw camera feed from official store apps. This means industrial grade AR toolkits like Vuforia will never be supported without some deep partnership where these companies make exclusive agreements to allow. Apple does this by controlling the pipeline and keeping it a black box to the developer. You can't touch the actual image feed coming in, through Apple's libraries it just gets funneled to the CV model for classification.
Meta could do the same, but they have to build a CV model, build the entire pipeline. Without this Mixed Reality is really just a gimmick. You could be very simple experiences, 3D table top games, things like that. But nothing beyond toys.
I do really learn something new from you. I am not familiar with this. Thank you!
