Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
Luandry's avatar
Luandry
Honored Guest
6 years ago

Lipsync From Other Means

Hello there, I am new to the forum, and working on a project currently for my Final Year Project in college. I am trying to build a virtual assistant which maps the output from a dialog system to the...
Audio
Lipsync
OVRLipSync UE4
ue4
en-austin's avatar
en-austin
Protege
6 years ago
The mic input processing is done in OnVoiceCaptureTimer(), which is invoked continuously as a UE4 timer function initialized as part of Start(). OnVoiceCaptureTimer() reads the mic input and transforms it into the byte array format expected by FeedAudio().
What I did for my project is remove OnVoiceCaptureTimer() entirely as well as it's initialization in Start(). Then I populated the Visemes member data directly with my canned viseme float data and finally called OnVisemesReady.Broadcast() to send this data to my Pawn driving the OVR Avatar.
It sounds like you might be close to getting your application working as you already have the audio data as raw PCM bytes. You might have a look at the final two lines of OnVoiceCaptureTimer() and replicate something similar without accessing the microphone:
TArray<uint8> AudioBuffer(VoiceData.GetData(), VoiceDataCaptured);





FeedAudio(AudioBuffer);