If only there was a way to generate images in real time with Stable Diffusion and any 3D software! Wait, there is?
I guess it depends on how much jank you can handle.
Today we'll be implementing a way to generate images with either Hyper SD or SDXL Lightning by sourcing an image directly from the viewport of any 3D app.
If you like my contributions, you can buy me a coffee here: https://ko-fi.com/risunobushi
Useful links:
- Hyper SDXL workflow: https://openart.ai/workflows/3ywJV6S8PjeQAV9o9X1W
- SDXL Lightning workflow: https://openart.ai/workflows/avGFtKiq0gVY4zOAzkHI
- Hyper SD models: https://huggingface.co/ByteDance/Hyper-SD/tree/main
- Juggernaut SDXL Lightning model: https://civitai.com/models/133005/juggernaut-xl?modelVersionId=357609
- Screenshare node (MixLab suite) github: https://github.com/shadowcz007/comfyui-mixlab-nodes?tab=readme-ov-file
- Popup Preview node github: https://github.com/NimaNzrii/comfyui-popup_preview
- Depth Anything and other ControlNet Auxiliary nodes github: https://github.com/Fannovel16/comfyui_controlnet_aux
Timestamps:
00:00 - Intro
02:02 - Screen Share Node overview
03:49 - Installing the required nodes and models
07:12 - Hyper SDXL workflow walkthrough
11:59 - SDXL Lightning workflow walkthrough
13:19 - Testing Blender x SDXL Lightning in real time
18:54 - Testing Blender x Hyper SDXL in real time
21:15 - More Testing with Popup Preview node
22:33 - Final Considerations and Outro
#stablediffusion #mixamo #blender #controlnet #adobemixamo #stablediffusiontutorial #ai #generativeai #generativeart #comfyui #comfyuitutorial #sdxllightning #3d #2d #illustration #render #risunobushi_ai #sdxl #sd #risunobushi #andreabaioni