Control AI with sketches: Here is how you can turn your storyboards into full AI movies for free!
If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz
Follow me on Twitter: https://twitter.com/mickmumpitz
This Stable Diffusion workflow can be combined with my character model sheet workflow for consistency. It's great for movie pre-visualization, concept art, or graphic novel panels, since it can handle multiple characters through automatic regional prompting. To demonstrate its full potential, I'll use it with Dream Machine, Claude 3.5 Sonnet, ElevenLabs, Udio, and DaVinci Resolve to create a full AI short film about the endless fight between knights and gnomes.
You can find the free workflow & guide here: https://www.patreon.com/posts/new-video-free-108432558?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
Advanced Workflow + example files: https://www.patreon.com/posts/advanced-next-ai-108435562?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=postshare_creator&utm_content=join_link
Character Model Sheet Workflow: https://youtu.be/849xBkgpF3E?si=WTZL4L8BIx5Ep30p
Chapters
00:00 Intro
01:00 Demonstration
03:00 Installation
06:00 Simple Workflow
09:23 Advanced Workflow
10:33 Tips & Tricks
11:12 Short Film Process
13:44 Final Short Film
15:45 Outro