Unreal Engine 5 | Enzo Behind the Scenes | Part 6: Metahuman Facial Motion Pipeline with Faceware

Опубликовано: 17 Декабрь 2024
на канале: Feeding_Wolves
6,283
164

Link to our short film Enzo:    • Enzo: Vitruvian Metahuman | Real-Time...  

This is the sixth part of the behind the scenes, where I share the pipeline I used in order to get Enzos facial motion performances into UE5. Enzo was brought to life using the mesh to metahuman plugin by ‪@3lateral4‬ & ‪@EpicGamesStore‬ in ‪@UnrealEngine‬ 5.

I captured the face and body performances using the Mark IV HMC by ‪@FacewareTech‬with the ‪@MovellaInc‬ & ‪@ManusMeta‬ integration. The Mark IV communicated with a Kipro using a ‪@Teradek‬ transmitter and receiver which then communicated with Facewares software, Shepherd.

I then streamed the performances into UE5 using the ‪@GlassboxTech‬ Live Client plugin. And all of this is powered by a ‪@PugetSystemsPC‬ workstation capable of running everything on a single machine.

Enzo came from the original character ‪@tomisackmann‬ created for his course on ‪@cgcircuitLLC‬ using ‪@MaxonVFX‬ Zbrush, ‪@Russian3dscannerSoftware‬ plugin Zwrap, ‪@Autodesk‬ Maya, Mari & Mudbox and ‪@Substance3D‬

Special thank you to Simon Kay (‪@mocappys‬ ), Josh Beaudry from Faceware, Norman Wang from Glassbox, Katie Jo Turk, Catarina Rodrigues, Arsène van de Bilt from Manus & Kelly Shipman from Puget Systems. These incredible people took the time to help me get my Metahuman motion capture pipeline set up and working in Unreal.

And special thank you to ‪@maxwarlond‬ for sharing his Metahuman Lighting setup.

~ Links ~

3D Character Artist Tomas Sackmann
~ CGCircuit Course: https://www.cgcircuit.com/bundle-deta...
~ Youtube:    / @tomisackmann  
~Artstation: https://www.artstation.com/sackmanntomas

Unreal Engine Artist Max Warland
~ Youtube:    • UE5 Metahumans Lighting  
~ Artstation: https://www.artstation.com/warlond

00:00 Intro
00:20 Syncing
00:48 Mocap Hardware
01:17 Software Integrations
01:40 Recording & ROMs
02:08 Unreal Live Client Setup
02:43 Motion Logic Blueprint
03:09 Faceware Studio Setup
03:33 Creating a Profile
04:03 Motion Effects
04:48 Multiplier
05:23 Live Client Control Profile
06:47 Recording & Optimization in Unreal


#metahumans #meshtometahuman #ue5 #unrealengine5 #3dcharacter #digitalcharacter #epicgames #virtualproduction #mocap #metahumancreator #nvidiartx