Which AR glasses to buy for research with LLMs and Raw data
Hello there,
I'm writing you because, together with a group of PhD and Master's students at my university, we are exploring the development of new mobile or web-based applications that can interface with the Meta Ray-Ban or Aria smart glasses via SDK.
Our goal is to test our own vision-language models (VLLMs) accessing directly the raw data streams—specifically video and audio—from the glasses and providing contextualized responses through the device’s built-in speakers using our own LLMs.
We are particularly interested in whether it is possible to develop a mobile app or even getting access through a web browser that can:
- Collect and transmit raw sensor data (video/audio)
- Send processed responses back to the glasses
- Use Bluetooth or an Android mobile app (possibly via XRCore or Unity) as the communication bridge
If this is feasible, could you kindly advise:
- Which smart glasses model(s) you recommend for this type of development. We want to buy some few glasses to start with
- What plugins, SDKs, or frameworks would be most suitable
We appreciate your guidance and thank you in advance for your support.
Best regards,
Luis F.