This video dives deep into a new Stable Diffusion workflow.
We're going to explore how to achieve Houdini-like Z-Depth manipulations and generate stunning animations using Stable Diffusion!
This technique involves creating depth maps and using them to guide the diffusion process, resulting in smooth animations.
Want to support me? You can buy me a ko-fi here: https://ko-fi.com/risunobushi
Shoutout to Ryanontheinside for creating this node pack: https://www.youtube.com/@UCWLSByG96v8vPHgZLv8UHVg
Run the workflow on RunComfy without any installations required: https://www.runcomfy.com/comfyui-workflows/comfyui-z-depth-maps-workflow-create-houdini-animations?ref=AndreaBaioni
Nodes: https://github.com/ryanontheinside/ComfyUI_RyanOnTheInside
Workflow: https://openart.ai/workflows/OhktQt9KCDlV8v5wF2Bx
If you want to check out my AnOther Magazine cover story, where I took care of the pipelines and workflow for generating the images, you can find it here: https://www.anothermag.com/art-photography/15858/art-in-the-age-of-ai-holly-herndon-mat-dryhurst-with-hans-ulrich-obrist
Models:
Loras (place them in ./ComfyUI/models/loras):
- https://huggingface.co/wangfuyun/AnimateLCM/blob/main/AnimateLCM_sd15_t2v_lora.safetensors
- https://huggingface.co/naonovn/Lora/blob/main/add_detail.safetensors
- https://huggingface.co/Lykon/LoRA/blob/7b44164cabdc9a4f34b4ef27f508dacde0a540e0/animemix_v3_offset.safetensors
AnimateDiff Evolved Lora (place them in ./ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/motion-lora):
- https://huggingface.co/peteromallet/poms-funtime-mlora-emporium/blob/main/LiquidAF-0-1.safetensors
AnimateDiff Evolved Checkpoint (place them in ./ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/models):
- https://huggingface.co/wangfuyun/AnimateLCM/blob/main/AnimateLCM_sd15_t2v.ckpt
Timestamps:
00:00 - Intro
01:21 - Quick Workflow Overview (Simple Single Animation)
04:13 - Quick Workflow Overview (Advanced Double Animation)
05:49 - Workflow Deepdive: Inputs
06:34 - Workflow Deepdive: Creating the Frames, Depth and Z-Depth Masks
09:54 - Workflow Deepdive: Simple Single Animation Generation
12:26 - Workflow Deepdive: Advanced Double Animation Interpolation
14:11 - Final Thoughts
15:14 - Outro
#stablediffusion #stablediffusiontutorial #comfyui #comfyuitutorial #houdini #zdepth