Skip to main content
New Participant
May 22, 2024

Suggestion for Developing an SDK for Meta Ray-ban Glasses

  • May 22, 2024
  • 29 replies
  • 62911 views

Hey everyone,

I'm curious: will there ever be a developer kit (SDK) available for Meta glasses? I think the glasses are great, but there's not much to do with them right now. So, I thought, why not build a community around it?

If Meta releases an API or something that other apps could call or interact with indirectly (since it seems there's already a service running in the background), this could enable commands from third-party apps. This way, you could allow users to develop their own apps and further customize the experience.

For example, let's say I want to do something customizable, like turning on my smart lights using the command "Hey Meta". My own app could register a command (or more than one) so that whenever I say "Hey Meta, [do something]", this command triggers (it could be a post or a deeplink) that my app could receive and then perform the desired action, only for that command. And if this API allows me to use the camera live, like we do in Instagram livestreams, the possibilities would be endless.

Think about it, everyone. I really want to build custom experiences with this, so please consider releasing an SDK for Meta glasses.

Thanks!

29 replies

New Participant
May 28, 2024

Came here looking for exactly this.

 

New Participant
May 28, 2024

I am looking for same. There are tons of ideas where we can add additional hooks. similar to Google Home Product or Siri Shortcut

DannarkAuthor
New Participant
May 29, 2024

Unfortunately, I checked out @boztank’s post, and if you look at the latest highlight stories from 05/20/24, he gave us a negative response 😔

Instagram Highlight

 

However, I still hope this decision changes. In my opinion, this product has the potential to be the best companion we can have right now.

 

Another awesome use case I’d love to see (or even develop myself) is this:

Imagine being able to interact with your computer through the glasses, making the experience even more seamless. Picture yourself in your home office, doing your regular work, watching a movie, or playing a game on your computer. If you could, for example, say, “Hey Meta, what do you think about this piece of code on my computer?” and it would trigger a small service on your desktop that immediately prints the image and sends it back to be processes and answered through the glasses. That would also work if you are playing a game and ask about something you see but don’t know what it is.

 

The reason for using a print instead of the cameras is to improve the fidelity of the responses, ensuring that the information processed is as accurate as possible.

But this is my usecases, I would love to hear yours

New Participant
July 1, 2025

Google is going to crush Meta if Meta doesn't publish a SDK, quickly.  Google already has published one and their glasses will be out soon.

ItzShaybaby
Inspiring
June 1, 2024

That sounds like an awesome idea, it would get the attention of a lot of people and sales will go up as well!

Opasch
New Participant
June 3, 2024

I think your best option here is:

https://www.projectaria.com/research-kit/

DannarkAuthor
New Participant
June 4, 2024

Wow, that project is incredible! I'm definitely going to learn more about it.

Honored Contributor
June 4, 2024

Even just integration with a service like IFTTT would be a great start

New Participant
September 12, 2024

I was thinking in create something using OpenCV to detect objects for Events area but apparently this will be the new google glass 

New Participant
October 6, 2024

I came here looking for this, I found a way to develop very basic solutions.

You can host a bot on Replit, that uses Twillio's whatsapp service.
Then you rename the number in your phone and send messages to activate things.

So far I only got a GPT response back, so a custom AI but with high latency.

Honored Contributor
October 6, 2024

mikameel  That's smart. Reminds me of the recent news about those two guys doing face recognition by streaming to Instagram and then doing some computer vision work on that feed https://www.theverge.com/2024/10/2/24260262/ray-ban-meta-smart-glasses-doxxing-privacy

New Participant
October 8, 2024

I´m also interested in the same issue. An SDK would be great to develop a lot of new use cases especially for the visually impaired people or help for cognitive impaired people. Please do it!