HowTo better inpaint with Differential Diffusion in ComfyUI AI, awesome results, precise controll
In this tutorial I walk you through a simple Differential Diffusion inpainting workflow in ComfyUI. Differential Diffusion gives you uch more controll over your inpainting with maps / masks which enables you to precisely controll the amount of inpaint at every area of your image.
Be sure to install all the needed custom nodes which are linked below.
Please comment if you have questions or tell me your suggestions for future videos.
Get this and many other workflows and files with BASE membership at Patreon:
www.patreon.co...
Sintific paper:
differential-d...
Custom Nodes:
github.com/ltd...
github.com/cub...
The Model:
huggingface.co...
Connect with me:
/ _neuron_ai
/ _neuron_ai
The equipment that I use (affiliate links):
GPU: ASUS ROG STRIX RTX 4090 amzn.to/42ptUTi
#comfyui #stablecascade #stablediffusion #tutorial #animatediff #automatic1111 #aiart #ai #inpaint #interpolation
Пікірлер: 21
Thank you! It works very well for me.
Good stuff again and thanks Olivio :)
@neuron_ai
3 ай бұрын
Olivio?
How to get Work Flow in Comfy UI, like Only Mask in Automatic 1111
@neuron_ai
3 ай бұрын
I dont know auromatic1111 so well and dont know what you mean. do you want to load the mask from somewhere else?
I'm using this method but the results are always disproportional with the rest of the image, e.g. body parts being much too large or small, or objects just completely missing the context of the photo
@neuron_ai
Ай бұрын
I discovered this a little bit as well. I will checkn if there is an error in the workflow or if this is a bug. be sure to use the same resolution for source img and latent.
How would you add a Lora Loader to this workflow? I tried adding one between the checkpoint and the diffusion node and it seems to obliterate my Lora?
@grm3
3 ай бұрын
I answered my own question: set the sampler denoise to less than 1. I found it working best at 0.8 and below.
Hey, where did you find the differentialDiffusion node ? I can't find it on the manager
@neuron_ai
3 ай бұрын
If you update your comfyui to the latest version it should be there. It is no custom node.
whats the name of plugin you used for connecting nodes together so regular?
@neuron_ai
Ай бұрын
it might be a standard setti g in the comfyui settings. but It could be also in the pythongossss addon or the manager.not sure right now.
@sasansa9684
Ай бұрын
@@neuron_ai thank you, its Pythongosssss Scripts
Hi! May I ask a question? Can "differential diffusion" be used with controlnet? I heard that there's a new, more accurate inpainting tool called "BrushNet". I've tried it out, but it seems like it can't be used with a controlnet. Is it possible to use "differential diffusion" with controlnet? If it's possible, I'd like to give it a try. Thanks!
@neuron_ai
3 ай бұрын
Didn't try it myself yet. So can not say.
@rei6477
3 ай бұрын
I tried for several hours, but it didn't work out. It's sad, but I'm probably giving up thanks for your reply though 👍
@neuron_ai
3 ай бұрын
@@rei6477 sorry for that, I will tell you if I find a way.