ComfyUI 16 Controlnet + IPAdapter Workflow (free download)

Тәжірибелік нұсқаулар және стиль

Controlnet (kzread.info/dash/bejne/epapxJZvgabIg5M.html) and IPAdapter (kzread.info/dash/bejne/rJ6fudWAl7irqKw.html) can be combined in one ComfyUI workflow, which makes it possible to steer both the composition and the style & atmosphere of the AI generated images. Together with latent- and image upscaling and with face restore it makes for a great default workflow.
Link to the workflows from the video:
drive.google.com/drive/folders/1C4hnb__HQB2Pkig9pH7NWxQ05LJYBd7D?usp=drive_link
If there's trouble with the Latent Upscale node, try this one:
github.com/city96/SD-Latent-Upscaler
Link to a large collection of PNG image workflows:
drive.google.com/drive/folders/1GqKYuXdIUjYiC52aUVnx0c-lelGmO17l?usp=drive_link
Link to video on ComfyUI Manager:
kzread.info/dash/bejne/Z3V8pLSPka3Mac4.htmlsi=nGrBiBxhw0dGDJUl
Large collection of upscalers:
openmodeldb.info/

Пікірлер: 41

  • @DianneStudio
    @DianneStudio5 ай бұрын

    One of the best detailed ai explaining channel. Thank you so much for your hard work, knowledge and free workflows.

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    Thanks for your kind words, it's appreciated.

  • @matthewkolb9950
    @matthewkolb99505 ай бұрын

    Excellent video. Like your style. Thanks for the education and the workflows, they're very helpful! Happy to find you!

  • @elan4912
    @elan49125 ай бұрын

    I like all of your tutorial videos. Thnkas a lot for always sharing the workflows.

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    Glad you like them, thx for your feedback, it's appreciated.

  • @goldholder8131
    @goldholder81315 ай бұрын

    Thanks a ton for your contribution to spreading information about how to use this kinda stuff. REALLY appreciate it!

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    You're welcome, thanks for your feedback, it's appreciated.

  • @scopeyin3629
    @scopeyin36293 ай бұрын

    This was so informative… i got exactly what i needed which is quite rare on youtube ❤❤❤… thank you and ur voice was so calm and fun… loved every bit of this video

  • @rudyshobbychannel

    @rudyshobbychannel

    3 ай бұрын

    Thank you for your nice feedback, it's appreciated.

  • @chuckruscher7135
    @chuckruscher71355 ай бұрын

    Wonderful, thanks!!!!

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    You're welcome. Thanks for the feedback.

  • @JayNL
    @JayNL5 ай бұрын

    Lekker bezig Rudy (JDx)

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    Thx

  • @brgtubedev001
    @brgtubedev0015 ай бұрын

    You have such a brilliant way of explaining things. This has to be the best content on ComfyUI that I've seen so far. Your workflow is so well ordered and methodical and the results of your experiments are truly an eye-opener. I wonder if you have used the ComfyRoll Multi-ControlNet Stack to mix multiple ControlNets and whether it is preferable to adjust the image with one ControlNet at a time, rather than mixing weights from different ControlNets?

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    Thanks for your kind feedback, it's appreciated. Yes, I have tried the multi ControlNet Stack, but I found that I seldom have the need for more than one Controlnet at a time, I seldom use it. I can't tell if it is preferable to stack or not to stack ... I bet a couple of experiments can tell us.

  • @brgtubedev001

    @brgtubedev001

    5 ай бұрын

    @@rudyshobbychannel I feel the same way. For the most part, I think one ControlNet is sufficient to get the result, especially if lines are all you really need to guide the picture. I am just wondering what are the possible use cases for using a ControlNet Stack. Thank you again for making your tutorials. I really enjoy your straightforward style, and of course, the clear explanation of the concepts.

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    @@brgtubedev001 There are Controlnets that are about color, that can be a possible stack, but I rather do that with the IPAdapter. And I bet one could use a Canny for a room- or city layout and add an Openpose to put a character in.

  • @brgtubedev001

    @brgtubedev001

    5 ай бұрын

    @@rudyshobbychannel Yeah, I just came across the recolor ControlNet, that's an interesting one to try out. And I can sort of see where you are going with mixing a Canny with Openpose. That would be an interesting workflow indeed. Would it be right to say that instead of overlaying a character in, you would use this method to instead generate the character right in the scene?

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    @@brgtubedev001 I'll give it a try one of these days.

  • @imrsvhk
    @imrsvhk4 күн бұрын

    Thx for making these. Really like your style... I'm trying to follow along, but where can I download those controlnet models? specifically the one you select at 4:44min..

  • @rudyshobbychannel

    @rudyshobbychannel

    3 күн бұрын

    civitai.com/models/136070/controlnetxl-cnxl

  • @sunnytomy
    @sunnytomy4 ай бұрын

    I have watched many comfyui videos on youtube, this is definitely the best comfyui tutorial, thanks for your generous sharing. I encountered an error while loading the json file, it says textbox node is missing. But when I check in the comfyui manager, there is no textbox node. The error message actually points to the "Filename" box which is red. May I ask how to resolve this issue? thanks.

  • @rudyshobbychannel

    @rudyshobbychannel

    4 ай бұрын

    That node is part of the Derfuu mods: github.com/Derfuu/Derfuu_ComfyUI_ModdedNodes. It is meant to enter a filename for the images that can be saved in several nodes. You can also delete that filename node and then convert the inputs it was connected to, to widgets.

  • @sunnytomy

    @sunnytomy

    4 ай бұрын

    @@rudyshobbychannel thanks

  • @nekola203
    @nekola2035 ай бұрын

    Hi, thank you for sharing your workflows, which json file should I use?

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    Controlnet IPAdaper (Turbo)

  • @nekola203

    @nekola203

    5 ай бұрын

    @@rudyshobbychannel Thanks! after installing missing nodes it tells me I'm still missing LatentUpscaler and I can't find anywhere to download it.

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    @@nekola203 I think the one I used is part of the so called Efficiency Nodes. But you can also use any other Latent Upscale node that you can find and insert it at that spot.

  • @nekola203

    @nekola203

    5 ай бұрын

    @@rudyshobbychannel great thanks again!

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    I think this one should do the job too: github.com/city96/SD-Latent-Upscaler

  • @MakotoShibuya
    @MakotoShibuya2 ай бұрын

    Can you help me fix the Filename node? It is red, but it doesn't show up as missing under the manager. Much thanks!

  • @rudyshobbychannel

    @rudyshobbychannel

    2 ай бұрын

    It is part of this node collection: github.com/rgthree/rgthree-comfy Any other text/string output node will do by the way, and you could also just change the inputs it is connected to into widgets and then delete the node.

  • @YuriyLvov
    @YuriyLvov3 ай бұрын

    [IPAdapter] The updated 'ComfyUI IPAdapter Plus' custom node has undergone significant structural changes, rendering it incompatible with existing workflows.

  • @iresolvers
    @iresolvers3 ай бұрын

    I loaded your workflow and I get an error "InsightFace must be provided for FaceID models" anyone know what might be wrong??

  • @rudyshobbychannel

    @rudyshobbychannel

    3 ай бұрын

    It could be that you do not yet have all models or other resources needed. Carefully follow the guidelines on the IPAdapter Github site: github.com/cubiq/ComfyUI_IPAdapter_plus

  • @goliat2606
    @goliat26065 ай бұрын

    I generated woman face that i very like. Is any way to apply this face to rest of images which i will generate? Reactor or other face replace nodes makes face very bluury when image is bigger than 512x512.

  • @rudyshobbychannel

    @rudyshobbychannel

    5 ай бұрын

    IPAdapter could help, but I doubt if it can do a better job than Reactor. New tools are on the way, like this: github.com/ZHO-ZHO-ZHO/ComfyUI-PhotoMaker kzread.info/dash/bejne/dY2smKtpf8jadpc.htmlsi=98WjacGC-h5NAh0K

  • @goliat2606

    @goliat2606

    5 ай бұрын

    @@rudyshobbychannel I tried to use this PhotoMaker but i got very long error starts with: Error occurred when executing PhotoMakerLoader: Error(s) in loading state_dict for PhotoMakerIDEncoder: I tried IPAdapter but face is blurry or not much similar to source :(

  • @xscxsa
    @xscxsa2 ай бұрын

    unable to find out text box node

  • @rudyshobbychannel

    @rudyshobbychannel

    2 ай бұрын

    It is part of the Derfuu Nodes, can be installed via the Manager or via Github. You can also convert the inputs to widgets in the three nodes it is connected to and then delete it.