Realistic Humans In Unreal Engine breakthrough. VR Characters are going to get super real.

[LZoltowski]

Well, this escalated quickly! .. Using real motion capture and Epic's Unreal Engine things have moved ever so closer to realistic human characters in games and VR.

The potential is huge.

https://www.youtube.com/watch?v=9owTAISsvwk

https://www.engadget.com/2018/03/22/siren-epic-games-unreal-engine-vicon/

Making of:

https://www.youtube.com/watch?v=NW6mYurjYZ0

Another one

https://www.youtube.com/watch?v=mkkWCmljMSA

[Evileyes]

Wow, insane.. its almost too realistic. Picture going GTA on her, and the scream/graphics/blood... it would make you feel like a weirdo.

[LZoltowski]

Evileyes said:

Wow, insane.. its almost too realistic. Picture going GTA on her, and the scream/graphics/blood... it would make you feel like a weirdo.

Hopefully, that's where human empathy kicks in and leads to more meaningful games. Hellblade Senua's Sacrifice is a game I enjoyed thoroughly, its realism of the character really connected me with the game and I truly felt for her.

[LZoltowski]

Being able to use captured performance data on a different character with minimum effort.

https://www.youtube.com/watch?v=o1P37YM1_wE

[DaftnDirect]

Real time!!! that's insanely impressive.... so now, if it's possible to generate high enough quality scans of original actors and assuming there are some decent voice actors out there... it can't be long before it's a fast enough and cheap enough process to create new episodes of Star Trek, the original series.

[DarkTenka]

Really impressive ... though it looks like the capture for the mouth movements has the lower lip and corners of the mouth a little too wide/low. Other than that its near perfect. That one small problem is giving me serious uncanny valley vibes though 😞 ... hopefully they can polish it up a bit more.

[Anonymous]

This + ray tracing + AI + human ability to be different = HOLY MOLLY!! 2025 is going to be insane really!!!

Note: Actually I think that is using ray tracing for the lighting. Am I wrong? The shadows it makes when she moves + the reflecting of the skin.

One more step to that VR MMORPG everyone is dreaming about:) Really I felt like she was real enough. I mean we're never going to see 100% I dont think. There are way too many things about a human to really recreate everything, but that was close enough I am sure everyone will start to feel the realism in VR for sure. Here we come Log Horizon:D!

Now only if we can crack the food thing:)) Virtual tasting food.

Another thought: Why not just add another camera below the HMD and then track the lip movement to sync lip movements. As for the face, you could put sensors at the edge of the headset where it meets your face to capture movement of the face muscles (not a camera, I seen it before on something else, it captures the electronics as you move muscles around). That should give all the information you need without adding too much more hardware into the HMD to give a lot of input back to the character model. As for the eyes, use eye tracking. That should be coming anyways for FOV rendering. You should be able to capture color data of the eyes to match your real eye color. As for everything else - body tracking software to at least aim you the right way. I remember we talk about this a while back using cameras in another thread. You could use basic trackers to pin point your body parts and then using a model recreate them where they should be closely onto the 3rd model last position. BOOM we could in theory have this in less than 10 years. CV3 is going to be soo sweet :D! 

[Digikid1]

Nice. Maybe that Ready Player One movie is gonna make the real Oasis after all. 

[Shadowmask72]

DaftnDirect said:

Real time!!! that's insanely impressive.... so now, if it's possible to generate high enough quality scans of original actors and assuming there are some decent voice actors out there... it can't be long before it's a fast enough and cheap enough process to create new episodes of Star Trek, the original series.

So one track minded. Forget Star Trek, what about digital Porn!

[DaftnDirect]

Shadowmask72 said:

DaftnDirect said:

Real time!!! that's insanely impressive.... so now, if it's possible to generate high enough quality scans of original actors and assuming there are some decent voice actors out there... it can't be long before it's a fast enough and cheap enough process to create new episodes of Star Trek, the original series.

So one track minded. Forget Star Trek, what about digital Porn!

Haha, well porn was my first thought, I just decided to express my second thought publicly 🙂