MENU

Fun & Interesting

Multimodal AI Video Relight with IC-Light (ComfyUI, non-AnimateDiff)

Andrea Baioni 5,834 9 months ago
Video Not Working? Fix It Now

Try RunComfy and run this workflow on the Cloud without any installation needed, with lightning fast GPUs! Visit www.runcomfy.com/?ref=AndreaBaioni , and get 10% off for GPU time or subscriptions with the Coupon below. REDEMPTION INSTRUCTIONS: Sign in to RunComfy → Click your profile at the top right → Select Redeem a coupon. COUPON CODE: RCABA10 (Expires August 31) Workflow (RunComfy): https://www.runcomfy.com/comfyui-workflows/comfyui-product-relighting-video-workflow?ref=AndreaBaioni Workflow (Local): https://openart.ai/workflows/YxuxT1PkjeWCmnpSpwPs Want to support me? You can buy me a coffee here: https://ko-fi.com/risunobushi Can't stop / won't stop: video relighting for your product videos, with detail and color transfer, using IC-Light in a non-AnimateDiff environment! This workflow allows the users to get: - moving video + moving light mask - moving video + still light mask - still frame + moving light mask - still frame + still light mask (if you really think that's a good idea) Thanks to LinkedIn's Mauricio Tonon for the RIFE final pass suggestion! Check him out here: https://www.linkedin.com/in/mauricio-tonon-585722267/ Drag and drop the json workflow file from openart into ComfyUI and install the missing custom nodes, and grab the following models in case you're missing them: - LightBasedPicture ControlNet_: https://civitai.com/models/80536/lighting-based-picture-control-controlnet - 4x NKMD Siax upscaler: https://huggingface.co/gemasai/4x_NMKD-Siax_200k - epicRealism: https://civitai.com/models/25694/epicrealism?modelVersionId=143906 Timestamps: 00:00 - Intro 00:30 - Sponsor: RunComfy 00:46 - Workflow (Why Video Relighting) 01:37 - What it can do 02:38 - How it works, in depth (Inputs) 06:37 - How it works, in depth (Results) 07:13 - How it works, in depth (Generation) 11:06 - Cloud demo via RunComfy 16:25 - Frame Interpolation issues 17:27 - Disabling RAVE 18:18 - Final Considerations 18:59 - Outro #runcomfy #stablediffusion #stablediffusiontutorial #videorelight #comfyui #comfyuitutorial #relight #iclight

Comment