Skip to main content
motorsep
Inspiring
June 9, 2016

OVRLipSync plugin is out for UE4

https://github.com/ChairGraveyard/ovrlipsync-ue4

I am sure it's still raw, but better than nothing. Perhaps Oculus can help that fella to make it better and optimize for Gear VR ? :)

I'd love to have my NPCs talk with lip sync ;)
    This topic has been closed for replies.

    6 replies

    vrdaveb
    Inspiring
    June 9, 2016
    Sorry, the audio team is not planning to port OVRLIPSYNC to UE4 for at least a month or two. We will let you know when it happens.
    vrdaveb
    Inspiring
    June 9, 2016
    I've reached out to ChairGraveyard. Our audio team would love to chat if you have his/her contact info.
    n00854180t
    Up and Coming
    June 9, 2016
    Hey guys, ChairGraveyard here. 

    I've gone ahead and made an example project to show how to use the UE4 version of the plugin (quite straightforward, see example images below): https://github.com/ChairGraveyard/ovrlipsync-example

    The project has an example mesh to see it in action, and should work out of the box.

    VisemeGeneratActor event graph setup:



    SetMorphTargets function:



    MorphIdxToNames array: 



    As long as the mesh has the appropriate morphs as listed above, it will work decently well. I'm sure there are things I'm doing wrong, and bug reports are welcome!
    Twitter IndieDB
    motorsepAuthor
    Inspiring
    June 10, 2016
    What about drawn phonemes? (as opposite to skeletal mesh based phonemes)
    motorsepAuthor
    Inspiring
    August 8, 2016
    @vrdaveb

    Is this coming to 4.13 by chance? While community plugin is cool, it doesn't allow to use audio to drive NPCs lips (and I don't think this feature is coming into community plugin)
    vrdaveb
    Inspiring
    August 8, 2016
    Sorry, the audio team is prioritizing other work at the moment.
    Terms & ConditionsAccessibility statement