Forum Discussion
lfdharo
4 months agoHonored Guest
Which AR glasses to buy for research with LLMs and Raw data
Hello there,
I'm writing you because, together with a group of PhD and Master's students at my university, we are exploring the development of new mobile or web-based applications that can interface with the Meta Ray-Ban or Aria smart glasses via SDK.
Our goal is to test our own vision-language models (VLLMs) accessing directly the raw data streams—specifically video and audio—from the glasses and providing contextualized responses through the device’s built-in speakers using our own LLMs.
We are particularly interested in whether it is possible to develop a mobile app or even getting access through a web browser that can:
- Collect and transmit raw sensor data (video/audio)
- Send processed responses back to the glasses
- Use Bluetooth or an Android mobile app (possibly via XRCore or Unity) as the communication bridge
If this is feasible, could you kindly advise:
- Which smart glasses model(s) you recommend for this type of development. We want to buy some few glasses to start with
- What plugins, SDKs, or frameworks would be most suitable
We appreciate your guidance and thank you in advance for your support.
Best regards,
Luis F.
No RepliesBe the first to reply
Quick Links
- Horizon Developer Support
- Quest User Forums
- Troubleshooting Forum for problems with a game or app
- Quest Support for problems with your device
Other Meta Support
Related Content
- 11 months ago
- 8 months ago
- 2 years ago