MENU

Fun & Interesting

Advanced AI Projection Mapping Workflow

reflekkt 5,968 lượt xem 9 months ago
Video Not Working? Fix It Now

Generate projection mapping content for any object. Using comfyUI with some mask segmentation and controlnets, you can auto-generate unlimited content. You just need a mask of your projection surface and some style references.

Project Files: https://www.patreon.com/posts/advanced-ai-109356342
My IG: https://www.instagram.com/reflekkt_/

Overview of the Workflow:

1. Capture a photo from the projector's perspective.
2. Make a mask from that photo.
3. Select style references for your content.
4. Use comfyUI to generate content. (Set auto-queue to iterate through your style reference folder).
5. Interpolate the content with Flowframes and finalize the mapping in TouchDesigner or any other mapping software.

Links:

comfyUI installation: https://www.youtube.com/watch?v=E_D7y0YjE88&t=40s&ab_channel=MDMZ

Absolute Reality 1.8.1 model: https://civitai.com/models/81458?modelVersionId=132760

lcm-lora-sd15 https://huggingface.co/latent-consistency/lcm-lora-sdv1-5/tree/main

Flowframes Interpolation: https://nmkd.itch.io/flowframes

Pixel Upscaler Model: https://civitai.com/models/147817/realesrganx4plus

Comment