Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
lfdharo's avatar
lfdharo
Honored Guest
4 months ago

Which AR glasses to buy for research with LLMs and Raw data

Hello there,

I'm writing you because, together with a group of PhD and Master's students at my university, we are exploring the development of new mobile or web-based applications that can interface with the Meta Ray-Ban or Aria smart glasses via SDK.

Our goal is to test our own vision-language models (VLLMs) accessing directly the raw data streams—specifically video and audio—from the glasses and providing contextualized responses through the device’s built-in speakers using our own LLMs.

We are particularly interested in whether it is possible to develop a mobile app or even getting access through a web browser that can:

  • Collect and transmit raw sensor data (video/audio)
  • Send processed responses back to the glasses
  • Use Bluetooth or an Android mobile app (possibly via XRCore or Unity) as the communication bridge

If this is feasible, could you kindly advise:

  1. Which smart glasses model(s) you recommend for this type of development. We want to buy some few glasses to start with
  2. What plugins, SDKs, or frameworks would be most suitable

We appreciate your guidance and thank you in advance for your support.

Best regards,

Luis F.

 

No RepliesBe the first to reply