Simple animations with Blender and Stable Diffusion - SD Experimental

Generating animations with any 3D software and Stable Diffusion is easy. Explaining how takes a while. In this Stable Diffusion Experimental tutorial, we'll see how, with the power of anime and g- I mean, with the power of Blender, keyframes and two workflows, we can get good animations without worrying about EBSynth, Adobe After Effects, etc. All we need is a 3D scene, a way to turn stills from the scene into generated images, and an AnimateDiff / IPAdapter / ControlNet plug and play pipeline. Want to support me? You can buy me a coffee here: https://ko-fi.com/risunobushi Workflows: - Workflow 1, turn 3D keyframe 1 into generated keyframe 1, or turn 3D keyframes 2 to X into generated keyframes 2 to X: https://openart.ai/workflows/risunobushi/blender-any-3d-to-stable-diffusion-animations---workflow-1-3d-keyframes-to-generated-keyframes/VZRPKkiYYJUi7WV73lod - Workflow 2, turn generated keyframes into animations: https://openart.ai/workflows/risunobushi/blender-any-3d-to-stable-diffusion-animations---workflow-2-generated-keyframes-to-animation/W3dXQCoLzNcHuYssBKJT Resources: - IPAdapter & AnimateDiff pipeline by the one and only Latent Vision, upon which these workflows expand: https://www.youtube.com/watch?v=jc65n-viEEU - Adobe Mixamo: https://www.mixamo.com - LCM Lora Model: https://huggingface.co/latent-consistency/lcm-lora-sdv1-5 - AnimateDiff LCM Model: https://civitai.com/models/326698/animatediff-lcm-motion-model - QRCode Monster ControlNet Model: https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monster/tree/main - ControlGIF model: https://huggingface.co/crishhh/animatediff_controlnet/tree/main - AnimateDiff nodes: https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved - More AnimateDiff resources (other models): https://github.com/guoyww/AnimateDiff?tab=readme-ov-file Timestamps: 00:00 - Intro 01:13 - How it works 02:27 - Setting up the scene in Blender 06:48 - Generating keyframes from 3D keyframes 13:44 - Generating animations from the generated keyframes 26:18 - First Animation 26:44 - Setting up the refiner pass 28:12 - Refined Animation 28:51 - More Examples 30:05 - Outro #stablediffusion #animatediff #blender #controlnet #mixamo #animation #adobemixamo #stablediffusiontutorial #ai #generativeai #generativeart #comfyui #comfyuitutorial #sdxllightning #3d #2d #illustration #render #risunobushi_ai #sdxl #sd #risunobushi #andreabaioni