Forum Discussion

🚨 This forum is archived and read-only. To submit a forum post, please visit our new Developer Forum. 🚨
motorsep's avatar
motorsep
Member
9 years ago

OVRLipSync plugin is out for UE4

https://github.com/ChairGraveyard/ovrlipsync-ue4

I am sure it's still raw, but better than nothing. Perhaps Oculus can help that fella to make it better and optimize for Gear VR ? :)

I'd love to have my NPCs talk with lip sync ;)

6 Replies

Replies have been turned off for this discussion
  • vrdaveb's avatar
    vrdaveb
    Oculus Staff
    Sorry, the audio team is not planning to port OVRLIPSYNC to UE4 for at least a month or two. We will let you know when it happens.
  • vrdaveb's avatar
    vrdaveb
    Oculus Staff
    I've reached out to ChairGraveyard. Our audio team would love to chat if you have his/her contact info.
  • Hey guys, ChairGraveyard here. 

    I've gone ahead and made an example project to show how to use the UE4 version of the plugin (quite straightforward, see example images below): https://github.com/ChairGraveyard/ovrlipsync-example

    The project has an example mesh to see it in action, and should work out of the box.

    VisemeGeneratActor event graph setup:



    SetMorphTargets function:



    MorphIdxToNames array: 



    As long as the mesh has the appropriate morphs as listed above, it will work decently well. I'm sure there are things I'm doing wrong, and bug reports are welcome!
  • What about drawn phonemes? (as opposite to skeletal mesh based phonemes)
  • @vrdaveb

    Is this coming to 4.13 by chance? While community plugin is cool, it doesn't allow to use audio to drive NPCs lips (and I don't think this feature is coming into community plugin)
  • vrdaveb's avatar
    vrdaveb
    Oculus Staff
    Sorry, the audio team is prioritizing other work at the moment.