could you make a tutorial how to train a style?

just a note the provided config file appears to set "mixed precision" and "saved precision" to bf16 which leads to an error, and needs to be changed to fp16 manually

@maxnami

Жыл бұрын

I was wondering why didn't work on me and was that! thanks !!! also it defaul call the model "adams"

@sazarod

Жыл бұрын

@@maxnami yeah, and the default paths have K's settings, but otherwise it all works great!

@Rentoa

Жыл бұрын

thank you! i was wondering what i did wrong..... 😄

@dzft3w

Жыл бұрын

I read somewhere bf16 is not supported for some hardware. Mine is working

@turkeycannon161

Жыл бұрын

I was staring at my screen wondering what the hell was wrong, started looking at the comments and saw this, you just saved me hours of wondering what I was doing wrong.

I literally JUST asked some of the guys in the Stable Diffusion Reddit how to train a Lora and figured I'd check here to see if there was a video, and as usual you do not disappoint. My hats off to you, good sir! Thanks again for all your hard work!!!!

I generated a LoRA model in 12 minutes with my 3060Ti (8GB VRAM) using 30 images and the Basic Settings config file. Just had to adjust "Mixed Precision" and "Save Precision" to "FP16" instead of "BF16" and select "AdamW" in the "Optimizer" dropdown instead of "AdamW8bit". Thanks Aitrepeneur for this tutorial and all other tutorials you have made. They were very helpful to me. Much appreciated!

@ssajmon83

Жыл бұрын

I had the problem "returned non-zero exit status 1" Your changes solved the problem ;)

@wangchi_

Жыл бұрын

this worked for me as well - thanks!

@The_Harsh_Truth

Жыл бұрын

Thanks. I was wondering if my Rtx 3060ti could handle it. Now I will try it too.

@AdnyanaPriatna

Жыл бұрын

thx, but in my pc its give me adamW errors, so i disabled it and now it works. im using 2060 super

@Bookedtuyo

Жыл бұрын

this worked for me too! Thank you! but I have a few question, what is the difference? better training results? it is faster? because I still don't notice a difference

This is great! Thanks for keeping us up to date on these things. I honestly prefer having the training separate from my stable diffusion installation. Very easy to follow tutorial. I know the work it takes for these video's, much appreciated.

I can't believe how easy it is to make your own lora. I've wanted to generate images of lesser known characters for months now but no loras existed because they aren't popular enough, thank you for this.

This dude does such a great job walking through the steps and explaining everything.

Thaaaaank you!!! I went through so many videos and text guides and nothing worked because there was some obscure error just sabotaging everything. Now I'm up and running with a functional GUI thanks to you. Again, thank you! Great guide!

Gotta say I love seeing the community come together to create content like this. Thanks 🙏

In case anyone is following along, you no longer need to Set-ExecutionPolicy unrestricted for the newer versions.

@crobinso2010

11 ай бұрын

at 3:00 mark

Legend! Learnt so much from your videos my guy. Keep up gods work. 🙌

im new to this and try to learn everything important. your channel is such a BIG help! THANK YOU

I don't know what it is, but something about the way you explain things quickly but with such great detail is exactly perfect. I'm a little older than the rest of you guys, but I am able to (pretty much) keep up with the new methods and tools for SD thanks primarily to THIS channel. My 16 y.o. grandson now calls ME with SD questions. Thank you, Aitrepreneur. You are very much appreciated!

@artavenuebln

Жыл бұрын

same same. He explains just so well and doesnt leave out steps, other people assume you "just know"

@aaronhhill

Жыл бұрын

I wish my grandson was old enough to come to me with questions about SD!! I can't wait until he's old enough to understand art, I plan on teaching him everything I know. He'll be 5 this year.

@warsin8641

Жыл бұрын

ikr it's way better than reading tbh

@Utoko

Жыл бұрын

@@aaronhhill I mean there is a lot "for now knowledge", the field is moving so fast. In 1 year most of the "how you do this" stuff will be way different and easier.

@aaronhhill

Жыл бұрын

@@Utoko This is very true. I mean, most of the core principles may remain, and obviously the core principles of art will stay the same: perspective, composition, style, but yes the way things are done now will be very different in a year and far easier. My hope is that diffusion will change or become something radically different in the same way that GAN and Diffusion are different.

Excellent Video Thank you! One slight snag though, your json config file also changes all the directory folders to your personal file paths so people may get an error unless they reset the paths in the folders tab to their own file paths.

Absolutely amazing results!! Much better than training embeddings as previous explained method!! Thanks a lot!!

@kennethone6687

10 ай бұрын

embeddings are so unpredictable sometimes....this is so on the point it's impressive.

Extremely useful and very well documented tutorial. Thank you! 👍

Thank you for all the info. So far I'll say the "Save training state" option is also pretty useful for if you get something workable but it needs a little more training just give it another round using the last state saved in the model folder. As a heads up though the next training needs either the same amount or same images as the first or it won't start. I figured that out the hard way when I tried lowering the amount of images for one pass.

Awesome video! Thank you for making this. This should help bring the power of LoRA to many more folks out there!

@lefourbe5596

Жыл бұрын

i saw your videos before but couldn't make it run. now it freaking work thx to you and Kei. awesome work !

@Aitrepreneur

Жыл бұрын

Thank you Bernard for making the hard work for everyone ;)

@gamingthunder6305

Жыл бұрын

lora and hypernet are really good for changing the style of a model.

@Einscrest

Жыл бұрын

Thank you also! So awesome for you to even maintain a github repo.

Thank you sir for always providing tutorials for new tools!

Love you videos my friend. I've learned a lot!

Honestly, you need to talk about Kohya gui in general. A local dreambooth installation with a visual ui is exactly what i've been looking for.

3:23: Instead just write "Powershell" or "cmd" in the URL-bar of the folder you're in

@Anonymous-gu2pk

Жыл бұрын

I think I must have a different version of Powershell, because the commands didn't work there. Had to use "cmd" instead.

@SuperTakeoff

Жыл бұрын

@@Anonymous-gu2pk 🙏🙏

@videowatcher551

Жыл бұрын

or you could Shift + Right Click "Open Powershell Window Here".

Got my first ever lora model made! Thanks a lot supreme Ai Overlord!

Love it thank you! Your channel has been super helpful.

IMPORTANT NOTE : If you don't choose a custom model specifically, this process downloads a LOT of data, which isn't explained in this video. I clicked on "Train model", and it's started to download multiple files that are more than 3GB each. Ther's more than 15GB to download so the training works.

@bryantho5050

Жыл бұрын

Thank you so much for this, was extremely annoying trying to do this with my bandwidth and I already had SD 1.5 locally as well.

@sofiiseize

Жыл бұрын

Hi ! Where I need to go for do this ? how /were I choose that custom model ?

@MeowsyDancer

11 ай бұрын

this

Your tutorials are very good. I am brand new to all of this and have been able to easily follow along. You move and speak quite fast, but that's ok - this is youtube and I can keep rewinding. Your style is much preferred to some who talk too slow and take 25 minutes to get to the point, or others who show just results without explaining details. You do both very well. I can rewind, pause and take notes, and follow along. Thank you very much for this! Next I want to find out if I can continue to further train lora like we did SD model training like in your other videos. What I mean is: can you add more training to an existing lora? Can I start a basic one then train it further?

Omg I went from 400 steps taking 3 hours to 6minutes with these settings compared to one of your other tutorials. You're an absolute legend.

Again... I have followed many tutorials online, and yours is the only one that worked. Great job on explaining things, the others always skipped explanations.

Also note that if you want to launch cmd or powershell from inside a specific folder without having to copy the directory and use "cd" or "cd /d" you can click on the the file path when you have that folder open and just type either "cmd" or "powershell" into the address bar then press enter. That will open cmd or powershell with that folder already set as its directory for executing your commands. It's an easier way to get things done.

@AlastorsNight

Жыл бұрын

I had to do this because for some reason it wouldn't allow me to do so inside of powershell but, if I ran powershell from the directory itself, worked just fine.

@morphman86

Жыл бұрын

Or shift + right-click and select "open powershell window here".

@lincestudio4547

Жыл бұрын

THANKSSSS

@angel_of_rust

Жыл бұрын

how do you do that but with the admin cmd

@kennethone6687

10 ай бұрын

i'm a simple man, i'm admin, i click

3:23 [WIN10] to start the PowerShell in the open folder, just hold SHIFT and then right click on it, and choose "Open PowerShell in this folder" from the popup menu.

Excellent, just thank you for your work.

Been waiting on this video!

If you use the red button under Generate to show the Lora files, like I do, you don't need to install the Additional network extension, it uses a completely different folder for lora files (it looks for them in the extension folder, not in the model folder). I train my lora files with the Kohya gui and don't use his extension, and the files work anyway

Just fixed my problem, had to swich bp16 to fp16 mixed precision. Thank you for that tutorial!

@Y0y0Jester

Жыл бұрын

What card?

@lurker668

Жыл бұрын

@@Y0y0Jester rtx 2070 8G

@Y0y0Jester

Жыл бұрын

@@lurker668 nice, exactly the same here.

Bro I love your explanation... You are the best! cause you explain things in proper detail where others Lora training video I watch those dumbshit start anywhere and like there tutorial like they bloody doing favor on us they don't even mention why the heck those folders so for viewer we think there is something inside in those folders. but you are the guy who explain you created it so that big help for viewer to understand

Thanks for this video. I've finally trained my first LORA. Other guides were not working on my side.

From those of use with meager cards, thank you for including the minimum VRAM in title!!! Hate getting all excited about new AI only to find out after hours of trying that its not possible on my card. (yet)

@alejin9646

Жыл бұрын

Did it work for you? I don't want to make another installation attempt so that it doesn't work at the end XD. I only have 4GB of VRAM

@0ntimetaiment921

Жыл бұрын

@@alejin9646 Pretty sure 4GB will not be enough. I have 8GB and it sometimes crashes due to low memory.

Thank you for teaching us so much!

worked!! subscribed!

Can you please make an up-to-date version of this video. The setup process is vastly different.

@lukashere7803

10 ай бұрын

It's pretty similar, the biggest difference is the Kohya setup, and if you just read the messages in powershell, you should get it down easily

My basic system security alarms go off like crazy watching most these videos XD

Thank you for the training.

Thank you so much for this. This is awesome.

Information in this tutorial no longer corresponds to the links provided.

Any chance you can make an updated tutorial. The GitHub is completely different now and following the new instructions I can’t get it to work at all.

Thanks, managed to train my LoRA in 7 minutes with your config, 150 steps - 14 images

thank you very much!!!! it turned out really great!

great tutorial, thank you! Anything you recommend for training styles using this method?

@keng4574

Жыл бұрын

Hopefully he makes a vid on that as well. Definitely interested in styles for LoRA

HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx

@jpgamestudio

Жыл бұрын

牛逼！

@BernardMaltais

Жыл бұрын

A few tips. No need to install the additional network extension if you use the built-in auto1111 LoRA support... but the extension does bring up a nice set of tools you can use to augment the experience. Another one, I suggest to leave the bucketing option always turned on. If you use pre cropped images it will not touch them... but if inadvertently you have one with size, say 512x513... instead of failing to run, it will just resize it to 512x512 and keep going. Don't ask me why I know ;-)

@sv_gravity

Жыл бұрын

No one is doing style training tutorials and tutorials focused on how to do annotations of images for different type of image content. Please do one, if you know acually how to do it properly. Ty.

@sv_gravity

Жыл бұрын

@@BernardMaltais Why you know?

@BernardMaltais

Жыл бұрын

@@sv_gravity I have a general isea for the annotations/captioning. Essentially you want to describe everything you don't want to always associate to the person or style you are training. For style it is a bit more difficult and depend on what it is. I have nor done lora styles yet but I have an interesting dataset I could try... might learn a thing or two while trying.

My G, perfectly explained and easy to follow. solid like and subscribe

Thank you for the information.

one thing, on windows 11 (idk about windows 10) u can just type 'cmd' or 'powershell' without brackets in folder address bar and press enter and it will open in that folder so no need to go to it via CD and address paste

@daconl

Жыл бұрын

Works also in Win10

@Aitrepreneur

Жыл бұрын

I knew for cmd but not for powershell, thanks!

What advice would you have if you need to create LoRa for different characters in the same style? For example, the basic Stable Diffusion models don't know how to generate scenes from Futurama. How can I train one LoRa model to be able to get Futurama characters by including their names in the prompt? In Tagger I can make a text description for each source picture, the style 'futurama' and names of the characters can be entered there, but how to use descriptions to pictures in Kohya GUI?

Thank you so much its perfectly work ❤❤

u are the man. THx and keep the good work

I was trying this but getting errors at the start after copying and pasting the data into powershell near the start, it says I don't have Python installed. I do as I have SD installed(A1111) and working but I am concerned about installing this python, doesn't SD only work with an older version of Python or can i just go ahead and install it? Thanks

Please K do another tutorial for training local LORA's:) we will appreciate that:p

Thanks a lot! I was able to create a Lora for a character that sadly has too few fanarts. The result was mind blowing!

@buketerbil4778

Жыл бұрын

hey how long did it take you if you don't mind me asking

@brunomendoza5478

Жыл бұрын

@@buketerbil4778 about 10-15 minutes. I used only 10 images. Ryzen 7 5800X3D RTX 4070Ti

Actually useful Lora tutorial for stable diffusion ❤😊

Unfortunately, the installation has changed completely in the meantime. Could you please make an update video? Although the installation instructions are actually clear, I can't get it to work because several errors occur. Thanks for your videos

Great video! Quick Q, how would the training method change for: a) A style b) a specific object in a picture

@itskiggu

Жыл бұрын

The methods for person/face/object/style/concept/etc are pretty similar. The main change I notice is how you prompt to change focus. In the txt file you want to describe everything that you don't want trained as a concept that also appears in the image. It's hard to properly explain without examples, @kasukanra does a great job of describing this in their video "kasucast #13".

About 9 min with an old RTX 2080 8GB and 19 images. Great Tutorial, thanks :)

The pre-made json files helped a bunch because I was seeing different results even though I followed all the settings. Before using the config file the loss rate was jumping all over the place and after using your config file the loss rate stabilized. I think the erratic loss rate was why my loras weren't working out. I dunno what settings were different to mine but i use your config file for a base.

The kohya tutorial section is completely incorrect now. Does anyone know how to use it properly? Do I install to my Stable diffusion folder? and if so where, does it matter?

How many input photos is best? Is more better or there is a limit where results can downgrade? Edit: so im experimenting with amount (100 at the moment) of training photos. And best results get when i use lower number than 100_subject catalog name. Im using 30 at the moment and get best results into mixing face into model. Could be that i overtrain at some point but theere is no way to preview training live. Or there is but i cant find the catalog with generations.

I followed these steps, used the config file, and had much more success than trying to figure out settings on my own. Thank you. The trick for me was limiting the number of photos to 20 and using more repeats (100) like you suggested to get close to the 1500 step count with only 1 epoch. I also used only 512x512 images for both img and reg. This creates a usable LORA in about 20 minutes on a 3060 card, at about 1.8 it/sec.

@aduong13

6 күн бұрын

are you use 3060 12GB?

Yessss!!! It works like a charm!

at 3:02 we turn off some script security thing, should we turn that back on after we installed everything?

3:48 in poweshell cd doesn't need /d do change drive. PS doesn't even uses slashes for parameters, it uses dashes like bash

@itskiggu

Жыл бұрын

Thank you, it wasn't working with the /d and then I tried with just "cd E:\Kohya" and it worked

thanks for making this LORA vid.

Thanks for your time

I accidentally select "no" for the mixed precision instead of fp16 in enviroment setting and got error when training is there a way to change it? or i have to reinstall the Kohya_ss Thank u for the great explanation!

the git files have changed i think the tutorial is outdated by now,we need a new one

Good results and fairly quick on a 8gb 3060 using your settings json with 1 batch, thanks

Awesome Awesome Tut!!

Do we need to set the instance and class prompt using this method? I saw that you still used ohwx person, as you didn't highlight it in the video I thought it would be good to double check :)

For anyone with the "Error no kernel image is available for execution on the device" error. The "8bit adam" checkbox has been moved to "Optimizer" section as a dropdown instead on 2023/03/05 (v21.1.4). I have no idea which one to select but I tried until one worked.

@LuizHenriqueMiranda

Жыл бұрын

I changed to the first one "AdamW".

@BenyGoren

Жыл бұрын

TY VERY MUCH

Your videos are really clear for instructions. Love it. Unfortunately, this software has evolved a lot and lots of this does not apply. It would be great if you could do an updated version. OMW to check out your other pages to see if there is something posted on those.

Great work

Great tutorial, can you please share with us how to keep training our first model, to get more similar results? or if you already explained it on another video, point us to the correct path! Thank you again!

Is there any difference to creating a concept instead of a character? Can you do a tutorial on making clothes/poses/styles as well.

Thanks a lot!

amazingly tutorial!

Hi, I keep getting "RuntimeError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 10.00 GiB total capacity; 9.13 GiB already allocated; 0 bytes free; 9.26 GiB reserved in total by PyTorch)". I have NVIDIA GeForce RTX 3080 with 10G memory. I also used the low vram config. What should I do? Thank you!

Thanks. If you have a strong enough graphics card and don't mind how long a training takes what gives you the best quality and most consistent results for training a face? Dreambooth, textual inversion or Lora (or something else maybe)? Also from my understanding, only with Lora and textual inversion you can use the training results with various models whereas a dreambooth training is always tied to the model you've trained it with, is this correct? Thank you!

@Aitrepreneur

Жыл бұрын

You are correct yes, I still personally prefer DB, it feels more forgiving and more precise than TI and LORA but being able to use TI or LORA with any model is really nice too

@wagmi614

Жыл бұрын

@@Aitrepreneur when is the dreambooth with kohya tutorial dropping?

I love that you say GUII like you'd say it's ya boiii

You can just shift click inside the folder and click launch powershell from this location. Just a quick tip for the future

This is pretty cool but I would like to mention setting Execution Policies to not be signed is almost asking for trouble. Unless you are a power user I would NOT recommend doing thing. It make it way too easy to run malicious scripts/code.

@chiwa-info

Жыл бұрын

So what do we need to do in the process, plz?

Trainning my first Lora right now. For people with WEAK GPUs like me, it's taking 2 hours and 45 minute to train using 16 photos. I have a GTX 1660 Super with 6gb vram

@fadilabn9832

Жыл бұрын

Please inform us if it works fine on 6g vram And give us image number, res,other barameter Thanks

@vegacosphoto

Жыл бұрын

@@fadilabn9832 it worked like a charm.

@bhshkpl

Жыл бұрын

Was this with fp16? With full precision, it did train but it took 23 Hours!! Had some weird xformers issues with fp16

@marceloschild1032

Жыл бұрын

why does it take so little time? I'm using a 1660ti on a laptop and it's taking 5 hours using the low VRAM config file as it is with 14 images. Also I'm not being able to use the LORA model once trained. Somehow SD throws the same results whether I include the LORA prompt or not.

I used this method with impressive results for people (me and my wife) and my two cats (15 images each).

in the explore address bar highlight it and type pwsh and hit enter, and that will open powershell right there in that folder for you. similarly you can do the same thing for command prompt by typing cmd and hitting enter.

No matter what I do and how low I set the settings (even training 256x256) , I keep getting the RuntimeError "CUDA out of memory" issue. And it worked the first time I followed this tutorial, I don't get it... (it says that most of my 8.00GiB total capacity is already allocated).

@Bitcoin_Baron

Жыл бұрын

Same here, seems this tutorial is a one-time-only one!

@camprey

Жыл бұрын

My god, i tought i was the only one! The first time it worked like a charm, now i cant do anything with it!

will this work on a 2080 super 8 GB VRAM? Also how much more RAM does it take to do 786x786 for high a resolution dataset? Does the number of input images effect the VRAM usage? Where can I download more ram? and bears thanks as always!

Thank you very much

You can also open windows powershell to the folder you are in by Shift+Right Clicking anywhere inside the folder window and selecting "Open Windows Powershell Here."

I got a mistake pressing keybord arrow during choosing mixed precision. As a noncoder lol it took some time to understand that I just need to use numbers instead of arrows. Maybe it'll help someone with the same problem.

@chiwa-info

Жыл бұрын

Just 30 minutes after you posted, you helped me, thanks man!

If your having issues do each command line by line in powershell that is what ii had to do and it worked

Good job!

@Aitrepreneur

Жыл бұрын

Thank you! Cheers!

Nice implement, i get this error raise ValueError(err.format(mode="bf16", requirement="PyTorch >= 1.10 and a supported device.")) ValueError: bf16 mixed precision requires PyTorch >= 1.10 and a supported device. any idea =?

@hfoxhaxfox1841

Жыл бұрын

same :/

@sazarod

Жыл бұрын

@@hfoxhaxfox1841 manually change "mixed precision" and "saved precision" to "fp16" -- the config file messed that up

@iBaaCacHee

Жыл бұрын

@@sazarod Thanks fixed :D

@MovieCapzzz

Жыл бұрын

@@sazarod THIS

cant get this working, they changed the way you install it, would love a follow up video for LORAs, cheers !