Metahuman Cinematics Captured with DragonFly Virtual Camera in Unreal Engine 5

Опубликовано: 07 Октябрь 2024
на канале: Feeding_Wolves
9,462
293

It has been an amazing learning experience using the recently released DragonFly Virtual Camera by ‪@GlassboxTech‬ in ‪@UnrealEngine‬ 5.1 to capture this Metahuman performance.

This #VCam allowed me to recreate real world sensors and lenses in Unreal, combined with the ‪@ZEISSCinematography‬ CinCraft Mapper which generated accurate lens distortion ST Maps that I assigned to each lens.

Link to DragonFly Vcam: https://glassboxtech.com/products/dra...
Link to Zeiss CinCraft Mapper: https://cincraft.zeiss.com/us/mapper

The face and body performances were cleaned and fine-tuned entirely in Unreal with the Metahuman control rig and the custom Metahuman was created using the Mesh to Metahuman plugin, with a Paragon character head mesh.

Gear Used:
Xsens Link suit (body mocap) by ‪@MovellaInc‬
Xsens Metagloves (finger mocap) by ‪@ManusMeta‬
Mark IV HMC (facial motion) by ‪@FacewareTech‬
Live Client plugin (stream facial motion to UE5) by ‪@GlassboxTech‬
iPad and Gamevice (virtual camera)
Powered by a custom ‪@PugetSystemsPC‬ workstation with an‪@NVIDIA‬ RTXA6000

Sensor/Lenses inspired by:
~ RED Gemini 5K S35 & ARRI/ZEISS Master Prime 100mm T1.3
~ ARRI ALEXA Mini LF & ZEISS Compact Prime CP.2 85mm T2.1
~ RED Gemini 5K S35 & ARRI/ZEISS Master Macro 100mm T2.0
~ Custom S35 Sensor for a 16:9 image & Cooke-inspired 85mm Anamorphic/i (distortion Coefficients)

Special Thank You to:
Unreal Engine Artist ‪@maxwarlond‬ for providing the lighting/environment for this video!

The incredible team at Glassbox: Johannes Wilkes, Norman and Jason Wang and Natalie Fernandez for all of your help and support throughout the making of this! I have learned so much from this experience and loved every moment of it!

Arsène van de Bilt at Manus, for all of your feedback and support throughout this project with the glove data.

Josh Beaudry at Faceware for your continued help, feedback and suggestions with the facial motion data.

Kelly Shipman at Puget Systems for creating this incredible workstation with his amazing team!

Emanuele Salvucci, Franco Vilanova & Daniel Langhjelm for your rendering help and answering my late-night messages for help!

Thank you for your feedback:
PixelUrge (Metahuman Grooms)
Diana Diriwaechter & Sam Goldwater (lighting)
Lenny aka uDraper (clothes)
Marc Morisseau (MH Performance)
Alvaro Garcia Martinez & ‪@WoodyDevs‬ (Cinematography)
Simon Kay for being an amazing motion capture guide throughout my journey!

Music by ‪@epidemicsound‬

#metahumans #virtualproduction #ue5 #unrealengine5 #motioncapture #mocap #digitalhuman #meshtometahuman #nvidiartx #cincraft #zeiss #zeisscinematography #ARRI #gemini5k #shotonred #thecookelook #filmmaking #xsens #manusmeta #pugetsystems #liveclient #glassboxtech #Vcam