ULTIMATE CONTROLNET Starter Guide!

Ғылым және технология

This guide is your ultimate primer for everything ControlNet. ControlNet is the most popular and useful tool that can be used with Stable Diffusion, so in this video I run you through installing the ControlNet Extension
in Automatic1111, how to install all the ControlNet Models you need including the new SDXL Community ControlNet Models, as well as all the compatible T2I Adapters.
I go through every single model and show you what they do and what they're good for. So if you every wondered what the Depth setting was for, or what the SEG model output means, you're about to find out.
🔗 Links: 🔗
--------------------
SDXL Community ControlNet Models: huggingface.co/lllyasviel/sd_...
SD 1.5 Control net models: huggingface.co/lllyasviel/Con...
T2ia Adapters: huggingface.co/TencentARC/T2I...
Yaml files github.com/Mikubill/sd-webui-...
Color map for ufade20k & ofade20k: docs.google.com/spreadsheets/...
📖Chapters:📖
--------------
00:00 START
00:27 INSTALLING CONTROLNET IN A1111
01:41 UNIVERSAL CONTROLNET SETTINGS
02:34 CONTROL WEIGHT
03:01 CONTROL STEPS
03:18 RESIZE MODE
03:50 PREPROCESSORS AND MODELS
04:23 CONTROLNET CANNY
04:42 CONTROLNET DEPTH
05:07 CONTROLNET NORMAL
05:31 CONTROLNET OPEN POSE
06:02 CONTROLNET MLSD (MOBILE LINE SEGMENT DETECTION)
06:20 CONTROLNET LINEART
06:42 CONTROLNET SOFT EDGE
07:00 CONTROLNET SCRIBBLE
07:26 CONTROLNET SEG (SEGMENTATION)
07:58 CONTROLNET SHUFFLE
08:09 CONTROLNET TILE
08:55 CONTROLNET INPAINT
09:49 IP2P (INSTRUCT PIX2PIX)
10:11 CONTROLNET REFERENCE
10:24 T2IA
10:52 CONTROLNET UNITS
11:13 SWEET OUTRO
----------
AI Voice Credit:
ElevenLabs: elevenlabs.io/

Пікірлер: 62

  • @stephenclement3349
    @stephenclement33494 ай бұрын

    This has to be the clearest and most comprehensive descriptive tutorial of control net that I have seen. Again, your videos are top-notch! Saving these to rewatch and sharing these with my friends getting started

  • @asmodeusr1578
    @asmodeusr157810 ай бұрын

    The clarity at which you present this is spectacular. You're gonna grow man.

  • @Nrek_AI
    @Nrek_AI10 ай бұрын

    This was one of the best explanations for control net models I've watched. Concise but still very informative. Thank you my guy

  • @sheleg4807
    @sheleg48077 ай бұрын

    By far the best explanations in the field, can we expect more from you?

  • @themrkurin
    @themrkurinАй бұрын

    Your videos are very helpful, and I hope you will continue to release new ones.

  • @JonBear
    @JonBear9 ай бұрын

    You crammed all of that into an 11 min video. Best explanation of controlnet I have seen! I learned a ton of new stuff. I will be returning to this video whenever I need a refresher. Subbed!

  • @360VIDEOVIBES
    @360VIDEOVIBES11 ай бұрын

    So much I learned from this. Please talk in future about IP-Adapters from control net. The last button in the Controlnet. Maybe you need a separate video for that.

  • @InciteAI

    @InciteAI

    11 ай бұрын

    Glad you liked it! That's the plan, the update adding IP-Adapters dropped while I was finishing this video, so expect an update soon!

  • @LoneRanger.801
    @LoneRanger.8019 ай бұрын

    Hands down one of the best videos on Controlnet. Mate! You should make more videos. Your content is really good. A longer version of this video could include multiple image examples for each one + further drill down into multiple controlnets with image examples. Long forom content is much appreciated. Thanks again for putting this together.

  • @mohali4338
    @mohali43385 ай бұрын

    Exactly what I was looking for. Thanks for sharing.

  • @DavidDexterTheGenius
    @DavidDexterTheGenius11 ай бұрын

    Awesome!! Been waiting for this.

  • @michaelbuzbee5123
    @michaelbuzbee512311 ай бұрын

    I am going to be re-watching this for the foreseeable future. Thank you

  • @InciteAI

    @InciteAI

    11 ай бұрын

    You're welcome, gald you found it useful!

  • @ranks6670
    @ranks667011 ай бұрын

    Hands down, you're awesome. 5 videos, Top notch quality content. FOREVER A SUSCRIBER 🥰

  • @InciteAI

    @InciteAI

    11 ай бұрын

    Thank you, I really Appreciate that! :D

  • @freeEnd_
    @freeEnd_7 ай бұрын

    dude is the best at what he is doing right now on youtube, earned a sub bro

  • @InciteAI

    @InciteAI

    6 ай бұрын

    Thanks so much!

  • @moltimondi
    @moltimondi10 ай бұрын

    Great stuff ! Very comprehensive and humorous. Keep up the great work !

  • @chapicer
    @chapicer7 ай бұрын

    this is THE BEST video about control net. THANK YOU VERY MUCH!!!!!

  • @GalenMelchert
    @GalenMelchert4 ай бұрын

    superb video. thank you

  • @BezDDelnik
    @BezDDelnik9 ай бұрын

    Thank you very much for your work! It is extremely helpful. I don't even know how to thank you enough!

  • @dreamscapeyoutube
    @dreamscapeyoutube11 ай бұрын

    Probably the best tutorial i've seen for CN ! Finally a clear tutorial I can recommend to my subscribers that asks about controlnet :) By the way, I was thinking maybe we could colab together on some video subject. I'm trying to gather some SD content creator and create a community network, like back in the days with old YT.

  • @fioletoviymewok9665

    @fioletoviymewok9665

    11 ай бұрын

    For sure the best one out there

  • @InciteAI

    @InciteAI

    11 ай бұрын

    Thanks so much :D I'm still finding my way here on YT at the moment, so I'm just focusing on building up some content first, but defintely something I'd be interested in down the road!

  • @dreamscapeyoutube

    @dreamscapeyoutube

    11 ай бұрын

    You're already killing it ! Our Editing Style is quite similar, packing up info in condensed manner. And I like your sense of humor ;)@@InciteAI

  • @Simplelle
    @Simplelle9 ай бұрын

    Great tutorial, keep up w the good work

  • @TheKamrenB
    @TheKamrenB10 ай бұрын

    I've read that the control net preview was actually only a very close approximation of what controlnet is doing, hence why there was a checkbox option "preview as input" in case you wanted. It's not there in A1111 1.6, so maybe its accurate now.

  • @GriezoPhea
    @GriezoPhea4 ай бұрын

    Why did you stop making new video? All your videos here very detailed, easy to learn. You should do more.

  • @Andonchoto
    @Andonchoto8 ай бұрын

    Finally SD upscale Mask Blur, WORKS in the newest 1111 update,

  • @jonescrusher1
    @jonescrusher15 ай бұрын

    Perfect.

  • @williamriker7741
    @williamriker774110 ай бұрын

    Love your videos, great forensic dives. Can you do one on doing animated stuff in A1111?

  • @PRASADKULAL2505
    @PRASADKULAL250511 ай бұрын

    Awesome

  • @Spatial-Temporal-Film-Delve
    @Spatial-Temporal-Film-Delve3 ай бұрын

    Awesome!! thank you!! btw can you show us how to implement this function in ComfyUI.. and how to setup MuseV and MuseTalk in ComfyUI as well.. thank you!!

  • @vlodgoral8258
    @vlodgoral82584 ай бұрын

    does it matter which checkpoint i use for this?

  • @AndyHTu
    @AndyHTu11 ай бұрын

    I find your videos very very detailed and helps with small things al the other channels don't talk about. Keep doing your thing! You deserve much more followers than what you got. Hope you blow up. Now that I've kissed your @$$. Can you tell me what the Preprocessor Resolution does? LOL

  • @InciteAI

    @InciteAI

    11 ай бұрын

    Thanks! I really Appreciate that! My understanding is that this adjusts the resolution of the controlnet map that's created, so a higher resolution would give you a more detailed map. This costs more VRAM though, so it might cause issues or just take longer to generate an image if you're tight on VRAM!

  • @joe-5D
    @joe-5D8 ай бұрын

    So if i just have A1111 can i download SD 1.5 models and SDXL models???

  • @joesheble5458
    @joesheble545811 ай бұрын

    Every time I try to use OpenPose (SDXL 1.0, A1111 1.6.0, CN 1.1.407) I usually get an error very similar to this: "RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x2048 and 768x320)" How do I overcome this? What does it even mean?

  • @InciteAI

    @InciteAI

    11 ай бұрын

    I know this error was common when people tried using the Controlnet models with SD2.1. The standard models are trained on SD1.5 and don't play nice with other models. If you're using an XL model, I would double check that you've selected an openpose xl control net model (huggingface.co/lllyasviel/sd_control_collection/tree/main). I haven't had much time to test these out yet, so I'm not that familiar with them yet.

  • @joesheble5458

    @joesheble5458

    11 ай бұрын

    @@InciteAI Thanks, I was trying to use the SDXL 1.0 model, but as soon as I switched to the 1.5, or a model trained on 1.5 I was fine. Thank you though!!

  • @justinlloyd3

    @justinlloyd3

    10 ай бұрын

    It's trying to multiply two matrices that are not matching sizes. Basically the two models do not connect to each other. Like trying to plug a USB into a HDMI slot.

  • @graphicism
    @graphicism7 ай бұрын

    I'm just getting error after error... is all this irrelevant with the advent of XL models?

  • @user-kk2ve1un4u
    @user-kk2ve1un4u11 ай бұрын

    too much info , but it is nice explanation , waiting to to see an examples tutorials for most of these control net models

  • @InciteAI

    @InciteAI

    11 ай бұрын

    Yeah, ControlNet is pretty expansive, but I wanted to put together a worthy introduction. Definitely more to delve into here!

  • @r__b6095

    @r__b6095

    8 ай бұрын

    I thought you had a pretty good balance of detail tbf

  • @juedbe
    @juedbe6 ай бұрын

    Love your content. Thank you for all the work you put out. Been having problems running some Preprocessors in ControlNet a1111 and hoping you can help me. I've tried updating, deleting and reinstalling, I've tried running SD a1111 in different browsers, redownloading the models, tried etc., and I just keep getting the following error: " urllib.error.URLError: " Anything come to mind that could help me solve this? Like I mentioned, only a few preprocessors work. For example, for "Depth," only the "depth_zoe" works, all others give the error. For "OpenPose", none of the preprocessors work. This happens both in SDXL and in 1.5 models. "Canny" on the other hand, they all work. Any ideas would be great. Thank you in advance.

  • @InciteAI

    @InciteAI

    6 ай бұрын

    Hey there! That's a strange one for sure, and I haven't seen it before, but the error you're seeing is a network related error, and since I assume it's running locally, something might be interfering with the localhost. Might be worth checking your firewall or antivirus settings to see if they are interfering at all? I would check out anything you have running that may affect local networking, VPN etc. These are all uneducated guesses of course 😅 You could also try a fresh install of python if all else fails. Hope you figure it out!

  • @juedbe

    @juedbe

    6 ай бұрын

    Hi, @@InciteAI Thank you for taking hte time to respond. Hi, @BitesizedGenius Was actually was able to figure it out with the help of Chat GPT! Looking at the entire read-out in the Command Line there was actual paths to the missing Annotators for each of the Preprocessors. So, while I'm not actually sure what caused the underlying problem, I was able to download the missing files manually, and it seems to be working. Thank you again!

  • @ranks6670
    @ranks667011 ай бұрын

    A question what ias the difference between the t2iadapter and the control_v11 files ?

  • @InciteAI

    @InciteAI

    11 ай бұрын

    Well for the most part, they are 2 different ways to acheive similar outcomes. ControlNet and T2l use different network structure modification to control the image generation, so basically they impose themselves on the new generation slightly differently. It's thought that T2I adapters are faster and more specific, but ControlNet is more robust and detailed. (I should have put that in the video xD)

  • @ranks6670

    @ranks6670

    11 ай бұрын

    @@InciteAI Thanks you very much. Great video 👍🏾

  • @NamikMamedov
    @NamikMamedov11 ай бұрын

    How to get rid of bad fingers?

  • @InciteAI

    @InciteAI

    11 ай бұрын

    There's lots of things to try, openpose hands or inpainting comes to mind. There also som LORAs out there trained for this.

  • @NamikMamedov

    @NamikMamedov

    11 ай бұрын

    @@InciteAI honestly I didn't find any loras about fix fingers. they're all about models like Emma Watson or somebody else

  • @marcus_ohreallyus
    @marcus_ohreallyus11 ай бұрын

    Love the opening. Funny stuff

  • @InciteAI

    @InciteAI

    11 ай бұрын

    Thanks :D, I wanted to channel my inner David Attenborough xD

  • @benland223
    @benland2237 ай бұрын

    LOVE THIS VIDEO ON CONTROLNET! Like and sub from me!

  • @anthony.spaghenitalia
    @anthony.spaghenitalia10 ай бұрын

    Thank you for breaking it all down in plain English for morons like me. It's hard to find AI tutorials that don't assume tons of prior knowledge.

  • @cr4723
    @cr47233 ай бұрын

    The video content is very good. But it's too fast. Thumbs down, sorry.

  • @crobinso2010

    @crobinso2010

    3 ай бұрын

    Play at slower speed.

  • @cr4723

    @cr4723

    2 ай бұрын

    @@crobinso2010 I have made. And it was still too fast.

Келесі