Generate 3D Sets for your Short Films!

Today we'll be using AI tools to create virtual environments for your film projects!

We cover the entire workflow, from generating the 3D environment, to filming in a low-budget virtual production environment, to compositing your shot with some AI tips and tricks, like re-lighting your shot based on the environment you've created!

Chapters:
00:00 Intro
00:34 What is Virtual Production?
01:42 Generating a 360° image
03:17 Preparing the 3D Model [Depth Maps]
06:22 Filming the scene
08:05 Key out the actors
09:10 Generate Normal Maps
11:15 Putting it all together
14:11 Final Shots

Tools used in this video:
Skybox Labs by Blockade Labs: https://skybox.blockadelabs.com/
NVIDIA Canvas: https://www.nvidia.com/de-de/studio/c...
ControlNet for Stable Diffusion: https://github.com/lllyasviel/ControlNet
midjourney: https://www.midjourney.com/
High Resolution Depth Maps for Stable Diffusion WebUI: https://github.com/thygate/stable-dif...
Blender: https://www.blender.org/
CamTrackAR: https://apps.apple.com/us/app/camtrac...
Reality OBJ to USDZ Converter: https://apps.apple.com/de/app/reality...
After Effects: https://www.adobe.com/products/aftere...
Runway.ml: https://runwayml.com/
High Reslution Normal Maps for Stable Diffusion: https://github.com/graemeniedermayer/...
DaVinciResolve: https://www.blackmagicdesign.com/prod...
Reference to image plane: https://github.com/Pullusb/reference_...

Videos Links:
Avatar Featurette: Performance Capture:    • Avatar Featurette: Performance Capture  
Avatar & Avatar 2 Behind the scenes - How James Cameron Evolved Motion Capture in the Avatar Films:    • Avatar & Avatar 2 Behind the Scenes — How ...  
The Virtual Production of The Mandalorian Season Two:    • The Virtual Production of The Mandalorian ...  
Blender Motion Tracking - Room Transformation! by Ian Hubert:    • Blender Motion Tracking - Room Transformat...  
Grae n YouTube Channel:    / @grae_n  
Inpainting in Augmented Reality:    • Inpainting in Augmented Reality  
How to Make a Blur Node in Blender!:    • How to Make a Blur Node in Blender!  

❤️ Buy me a coffee:
https://ko-fi.com/mickmumpitz

Follow me on Twitter:   / mickmumpitz