Creating a 3D Model from a 2D Photo with GANverse3D and Nvidia Omniverse Create

Опубликовано: 13 Октябрь 2024
на канале: CODE MENTAL

14,296

198

#nvidia #ganverse3d #rtx #omniverse #create

Remember that a few months ago I talked about a new ground-breaking application, yet to be released, from Nvidia Research Labs, called GanVerse3D, capable of rendering 3D models with texture from 2D photos?
Not only that, GanVerse3D was also supposed to be capable of animating the 3D model at a click of a button.
Yes, the wait is finished. Anyone, who is lucky enough to own an RTX graphics card can now try this ground-breaking application in 3D Deep Learning.

All you have to do is to install Nvidia Omniverse.

Blog Article: https://spltech.co.uk/nvidia-ganverse...

Timestamps

0:00 Ganverse3D Flashback
0:55 Nvidia Omniverse and the metaverse
2:21 Audio2Face
2:51 Downloading and Installing Nvidia Omniverse Launcher
3:35 Installing Nvidia Omniverse Create
3:43 Trying the demos in Nvidia Omniverse Create
5:04 Installing and activating Ganverse3D Extension
5:10 Creating a ground plane in physics scene
5:30 Converting a 2D photo of a Porsche to a 3D animated model
5:55 Driving the 3D model of a Porsche
6:09 Converting a 2D photo of an SUV to a 3D animated model - FAIL
6:55 Converting KITT from the Knight Rider to a 3D model
7:30 Testing the cars in a special game scene
7:45 Summary of Nvidia's research - DatasetGAN, GanVerse3D and DIB-R papers

RELATED VIDEOS

Nvidia Ganverse3D demo
   • GANverse3D: Knight Rider KITT Re-crea...

Synthesizing High-Resolution Images with StyleGAN2
   • Synthesizing High-Resolution Images w...

NVIDIA's Work in AI
   • NVIDIA's Work in AI

Pascal3D+ Annotation
   • PASCAL3D+ annotation

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization (ICCV 2019)
   • PIFu: Pixel-Aligned Implicit Function...

CONTACT ME FOR CONSULTING AND ANY OTHER BUSINESS ENQUIRIES

[email protected]

SUPPORT THE CHANNEL or get MENTORING

  / codemental

FOLLOW ME

Instagram:   / codemental
Blog: https://spltech.co.uk/blog/

My Equipment:
If you are curious about what equipment I use and you want to support the channel, feel free to check my affiliate links

Sony Vlog Camera ZV1
US: https://amzn.to/39Xlx7n
UK: https://amzn.to/3fYCEcW

Rode Wireless GO
US: https://amzn.to/2PIrVZq
UK: https://amzn.to/3mGSiuM

LIGHTING - Neewer 3 Packs 530 RGB Led Light with APP Control
US: https://amzn.to/39Ymdcq
UK: https://amzn.to/3uCunzd

Manfrotto Variable Friction Arm with Bracket, Super Clamp
US: https://amzn.to/320MRND
UK: https://amzn.to/322Xuj8

Raspberry PI
US: https://amzn.to/3mwpwgi
UK: https://amzn.to/3wIs27P

Raspberry Pi HQ Camera
US: https://amzn.to/3d4nelc and for lense https://amzn.to/3uBOTjx
UK: https://amzn.to/2PIaGHH

Deep Learning and Gaming PC COMPONENTS:

AMD Ryzen 5900X CPU
US: https://amzn.to/3c1Iubi
UK: https://amzn.to/2KDY0ih

Gigabyte GeForce RTX 3070 EAGLE OC 8GB Graphics Card
The model I bought is unavailable in the US store, so I replaced it with.a similar model from
Gigabyte with slightly higher specs:
US: https://amzn.to/2Y4tu4d
UK: https://amzn.to/394pAia

ASUS ROG Strix X570-E Gaming ATX Motherboard, AMD Socket AM4
US: https://amzn.to/3oa9tnB
UK: https://amzn.to/3iAHtrU

Corsair iCUE H150i PRO XT RGB Liquid CPU Cooler (360mm)
US: https://amzn.to/2LYCFRp
UK: https://amzn.to/2Y1DCuG

Crucial Solid State Drive 1TB
UK: https://amzn.to/2KP797W
US: https://amzn.to/39X8xhf

PC Case - Phanteks Eclipse P600S
US: https://amzn.to/3c3sEgn
UK: https://amzn.to/2LNARL7

Memory - Corsair Vengeance RGB Pro 32GB (2x16GB) DDR4 3600- Black
US Amazon: https://amzn.to/3c1PuVC
UK Amazon: https://amzn.to/2Y5mJzm

Power Supply - CORSAIR CX750F RGB - 750 Watt, Fully Modular
US: https://amzn.to/399oaTz
UK: https://amzn.to/2Md2won