Forum Discussion
Luandry
6 years agoHonored Guest
Lipsync From Other Means
Hello there, I am new to the forum, and working on a project currently for my Final Year Project in college. I am trying to build a virtual assistant which maps the output from a dialog system to the...
en-austin
6 years agoProtege
The mic input processing is done in OnVoiceCaptureTimer(), which is invoked continuously as a UE4 timer function initialized as part of Start(). OnVoiceCaptureTimer() reads the mic input and transforms it into the byte array format expected by FeedAudio().
What I did for my project is remove OnVoiceCaptureTimer() entirely as well as it's initialization in Start(). Then I populated the Visemes member data directly with my canned viseme float data and finally called OnVisemesReady.Broadcast() to send this data to my Pawn driving the OVR Avatar.
It sounds like you might be close to getting your application working as you already have the audio data as raw PCM bytes. You might have a look at the final two lines of OnVoiceCaptureTimer() and replicate something similar without accessing the microphone:
TArray<uint8> AudioBuffer(VoiceData.GetData(), VoiceDataCaptured);
|
Quick Links
- Horizon Developer Support
- Quest User Forums
- Troubleshooting Forum for problems with a game or app
- Quest Support for problems with your device
Other Meta Support
Related Content
- 2 years ago