Forum Discussion
Audio 2 Expression (A2E) with audio files
Hi,
does the new Audio2Expression feature only work with audio from the microphone? I didn't find a way to feed in some other kind of audio stream. Not sure what the use case would be just using the mic, besides the existing demo? The more obvious use case would be to use it like OVRLipSync to sync any character / NPC lip movement with audio, but this does not seem possible right now?
9 Replies
Replies have been turned off for this discussion
*bump* I can not be the only one wanting to use this feature, so would like to know if this is just a showcase for now or if it's anyhow usable without direct mic input? I mean, what would be the use case of reacting to mic input anyway? Seeing yourself in a mirror as a speaking character? I cannot imagine any reasonable use case with current integration.
I am also interested in how to use the Audio To Expression Feature for NPC-Avatars. I just cheked out the newest version (v72) but also could not find a way to use an audio clip as input for A2E instead of the headset microphone. At the moment the only supported use-case seems to be the own vatar in multiplayer applications.
It would be helpful to know if and when the use of Audio to Expression based on other inputs, such as an audio source/clip will be supported. Is that something that is in the works? Has anayone else tried to do this?Where did you find the A2E files? Is there a demo scene for it?
They call it Facetracking in the SDK. You can use it without facial sensors though as well (i.e. on Quest2/3). Then it is just based on the audio stream from the mic. For that you need the Meta Movement SDK; the FaceTracking Samples that you can downlowad for that package let you test out A2E with the mirrored Avatars.
BUMP!
We need this feature to be pluggable on regular audio source components! I can't believe it's only usable on microphone input!
another bumb. still not sure how this can be announced as a great feature if it only works on a non existing use case....
I am also looking for the promised A2E solution. I can't even access the microphone version in v77.0.2
Could it be that they removed even this and microphone support is also no more there?I asked on the GitHub of movement sdk. Seems there are no further plans to make this feature usable. It’s a waste of time (ours and of Meta). Not sure why this was even announced.
Thank you for answering. That's sad because it seemed to be promising.
