In this episode of Stable Diffusion Experimental, we explore CatVTON, a fantastic Virtual Try-On (VTON) tool that's great at creating working bases for generative clothes swaps. As a fashion photographer, I explain why this model excites me and how it outperforms previous VTON attempts.
Wanna support me? Buy me a ko-fi here: https://ko-fi.com/risunobushi
Workflow: https://openart.ai/workflows/HaxcrNaVvjae9pdkut64
GitHub (ComfyUI wrapper): https://github.com/chflame163/ComfyUI_CatVTON_Wrapper
GitHub (base implementation): https://github.com/Zheng-Chong/CatVTON
Paper: https://arxiv.org/pdf/2407.15886
Install guide:
- go to your ComfyUI/custom_nodes folder
- open in terminal
- paste the following command: git clone https://github.com/chflame163/ComfyUI_CatVTON_Wrapper.git
- go to your ComfyUI/custom_nodes/ComfyUI_CatVTON_Wrapper folder and open in terminal, or type "cd ComfyUI_CatVTON_Wrapper" after git cloning
- type "pip install -r requirements.txt"
- if errors appears, try either "pip install -r requirements.txt --user" or force install the required versions for the dependencies errors
- get all the models from the GitHub page, or from my HuggingFace repo here: https://huggingface.co/risunobushi/catvton_model_lib/tree/main
- place them in ComfyUI/models/CatVTON (if you don't have that folder, create a new one and rename it CatVTON)
Timestamps:
00:00 - Intro
00:51 - Why is CatVTON great?
01:28 - What are VTONs?
02:55 - The CatVTON Wrapper node
04:10 - Building the pipeline
05:53 - First Test (T-Shirt 1)
07:23 - Second Test (T-Shirt 2)
07:58 - Third Test (Jacket)
08:52 - Resolution Issues
10:13 - Fourth Test (Printed Sweater)
10:45 - Fifth Test (Printed Shirt)
11:30 - Sixth Test (FP32 and higher CFG)
13:11 - Installation Process
15:31 - Outro
#CatVTON #VirtualTryOn #AIFashion #StableDiffusion #ComfyUI