Exploring ChatGPT Integration for VR UI/UX: Has Anyone Tried It?

Hi everyone,

I'm currently experimenting with ways to integrate conversational AI (like ChatGPT) into VR environments to enhance user onboarding, contextual help, or dynamic NPC interactions. I’m working with Unity and targeting Quest 2/3.

My goal isn’t to run the model locally, but to connect to external APIs (e.g., OpenAI) via secure HTTPS requests — ideally triggered by user input or voice in immersive menus.

I’d love to hear from other devs:

Have you tested anything similar in a VR context?
What are your thoughts on latency and user flow when connecting to external services in VR?
Any advice on best practices for handling text responses (display, formatting, user focus)?
Are there any sample projects or SDKs that play well with Meta Quest platforms for this use case?

This is still a prototype phase for me, but I believe natural language interaction could really improve the way users explore VR content — especially for onboarding or educational apps.

Looking forward to your insights!