It has been an amazing learning experience using the recently released DragonFly Virtual Camera by @GlassboxTech in @UnrealEngine 5.1 to capture this Metahuman performance.
This #VCam allowed me to recreate real world sensors and lenses in Unreal, combined with the @ZEISSCinematography CinCraft Mapper which generated accurate lens distortion ST Maps that I assigned to each lens.
Link to DragonFly Vcam: https://glassboxtech.com/products/dra...
Link to Zeiss CinCraft Mapper: https://cincraft.zeiss.com/us/mapper
The face and body performances were cleaned and fine-tuned entirely in Unreal with the Metahuman control rig and the custom Metahuman was created using the Mesh to Metahuman plugin, with a Paragon character head mesh.
Gear Used:
Xsens Link suit (body mocap) by @MovellaInc
Xsens Metagloves (finger mocap) by @ManusMeta
Mark IV HMC (facial motion) by @FacewareTech
Live Client plugin (stream facial motion to UE5) by @GlassboxTech
iPad and Gamevice (virtual camera)
Powered by a custom @PugetSystemsPC workstation with an@NVIDIA RTXA6000
Sensor/Lenses inspired by:
~ RED Gemini 5K S35 & ARRI/ZEISS Master Prime 100mm T1.3
~ ARRI ALEXA Mini LF & ZEISS Compact Prime CP.2 85mm T2.1
~ RED Gemini 5K S35 & ARRI/ZEISS Master Macro 100mm T2.0
~ Custom S35 Sensor for a 16:9 image & Cooke-inspired 85mm Anamorphic/i (distortion Coefficients)
Special Thank You to:
Unreal Engine Artist @maxwarlond for providing the lighting/environment for this video!
The incredible team at Glassbox: Johannes Wilkes, Norman and Jason Wang and Natalie Fernandez for all of your help and support throughout the making of this! I have learned so much from this experience and loved every moment of it!
Arsène van de Bilt at Manus, for all of your feedback and support throughout this project with the glove data.
Josh Beaudry at Faceware for your continued help, feedback and suggestions with the facial motion data.
Kelly Shipman at Puget Systems for creating this incredible workstation with his amazing team!
Emanuele Salvucci, Franco Vilanova & Daniel Langhjelm for your rendering help and answering my late-night messages for help!
Thank you for your feedback:
PixelUrge (Metahuman Grooms)
Diana Diriwaechter & Sam Goldwater (lighting)
Lenny aka uDraper (clothes)
Marc Morisseau (MH Performance)
Alvaro Garcia Martinez & @WoodyDevs (Cinematography)
Simon Kay for being an amazing motion capture guide throughout my journey!
Music by @epidemicsound
#metahumans #virtualproduction #ue5 #unrealengine5 #motioncapture #mocap #digitalhuman #meshtometahuman #nvidiartx #cincraft #zeiss #zeisscinematography #ARRI #gemini5k #shotonred #thecookelook #filmmaking #xsens #manusmeta #pugetsystems #liveclient #glassboxtech #Vcam