I tried to build a ML Text to Image App with Stable Diffusion in 15 Minutes
What's happening guys, welcome to the sixth episode of CodeThat!? I think
So there's been a lotta talk about text to image generation using machine learning...well I thought I would give it a crack and try to whip up a Python App that could do it.
And along comes Stable Diffusion, an open source SOTA model for text to image generation from Stability AI, well the rest is history. In this ep we focus on using the Stable Diff model through Hugging Face Diffusers and build up an app using Tkinter so that you can use it on your desktop with nothing more than a 4GB GPU.
Get the Code: github.com/nic...
Oh, and don't forget to connect with me!
LinkedIn: bit.ly/324Epgo
Facebook: bit.ly/3mB1sZD
GitHub: bit.ly/3mDJllD
Patreon: bit.ly/2OCn3UW
Join the Discussion on Discord: bit.ly/3dQiZsV
Happy coding!
Nick
P.s. Let me know how you go and drop a comment if you need a hand!
#machinelearning #codingchallenge #tkintertutorial #python
Пікірлер: 333
Code it here team: github.com/nicknochnack/StableDiffusionApp
@NicholasRenotte
Жыл бұрын
@@ShineSincere check the github repo, I updated it to include the file. You just need to get your token from Hugging Face hub
I've wanted to make a Stable Diffusion UI ever since the model became public, but didn't know where to start as I'm not used to Python, but now you've given me a great start! Thanks!
Hey Nick. You're my favourite KZreadr of all time. Thank you so much for sharing your knowledge with us. I have learnt so much from you.
@NicholasRenotte
Жыл бұрын
Oh that means a ton to hear @Rohit! I'm so glad you're enjoying it!
@Quantumvp
Жыл бұрын
@@NicholasRenotte Hi Nick I have tried to complete the project but when i get to the end and ready to deploy I get this raise EnvironmentError( OSError: There was a specific connection error when trying to load CompVis/stable-diffusion-v1-4: (Request ID: eYm7eENfp-7CbfSsEEf53)..
You have to be my best youtuber yet. You push me to do more daily, you are an inspiration Nicholas !!
@NicholasRenotte
Жыл бұрын
That means a ton @Atunrase!! Keep at it!!
@atunraseayomide2504
Жыл бұрын
@@NicholasRenotte 😁💯💯
@anirbanpatra3017
Жыл бұрын
Is there a way to deploy this project??
BRO I HAVE FOUND DIAMOND WHILE I WAS SEARCHING FOR GOLD ---- THANK YOU FOR THE GREAT CONTENT
@NicholasRenotte
Жыл бұрын
Ohhhhhh man, thank you soooooo much!!
Hey Nicholas, I have been away from AI since almost a year now but this video is sort of pushing me to start looking back into it. Awesome one mate !! Let us catch up for a coffee some day in city.
@NicholasRenotte
Жыл бұрын
VARUN! Hell yes, whenever you're ready let's do it!
@jacob4316
Жыл бұрын
@@NicholasRenotte What city is that? I'd like to link up and discuss a business opportunity. I need a good dev!
wow thats an awesome idea for a video !!! PS: you are a really great youtuber i enjoy your content a lot
@NicholasRenotte
Жыл бұрын
Thank you so much @Noah!!
hey Nick! I believe that the code link in the description is a link to another project of yours. Absolutely amazing video as always, keep up the good work. Cheers!
@NicholasRenotte
Жыл бұрын
Updated, thanks a mil @Egemen!
hey nick thank you for bringing content like these .This is really so helpful .How to learn everything about diffusion models.How it works.tech behind it and how it works.make a small diffusion model from scartch.
I like your videos from the instructional aspect. However honestly I don't care of you google it or stack it or copy paste from notepad. Who cares? Just explain how it works and teach us. We are not trying to give you a grade based on speed or copy paste.
@NicholasRenotte
Жыл бұрын
Thanks a mil @Angels Mobile! I add those constraints to make it challenging for myself as well, forces me to push myself to do better for you guys!
@Aidev7876
Жыл бұрын
@@NicholasRenotte that's fine man. I guess I'm older than the average in this group. So the other guys may like the challenging aspect you are doing. Although my comment got 10 likes so I'm not quite sure... In real life, nobody is going to check if you used Google and actually there is a value showing how to search for help real-time cause everyone will learn from that part too. But hey. As I said. Your content is great and you do have lots of positive energy. Up-to you if you want to keep the timer and no internet check. My 1 cent 😀
@Aidev7876
Жыл бұрын
@@domehouse79 ?
@ProfessorThock
Жыл бұрын
He obviously had to learn all of this stuff and check the documentation beforehand anyway so it doesn’t really make much of a difference. He’s just going off memory from what he coded beforehand right? Pretty sure the 15 minute thing is just a fun/gimicky way of showing that it doesn’t have to take long to do something cool
@Pythonist_01
7 ай бұрын
@@NicholasRenotteplease help me out with the authtoken library it's not working on my python I've tried everything
I absolutely love your videos my friend. You’ll be absolutely BLOWN away at the implementation this AI can achieve. My page has over 10 animations created with SD, and if you’re not interested, just check out all the other pages that use SD to create animations. What a world we live in. Truly insane!
@NicholasRenotte
Жыл бұрын
Sweet!!
Woohooo! You did it!!! AMAZING!! Super impressive work Nick!
@NicholasRenotte
Жыл бұрын
WE MADE IT MARY!!!! 😂😂
Awesome work as always, Nich!
Hey Nick. Thank you very much for your content. I really like your videos and they helps me understand more and more about ML!
@NicholasRenotte
Жыл бұрын
I'm so glad you're enjoying them @Gabriel!
did anyone else find difficulties to run this code?? I can't generate any images its showing me error:'sample'
That's awesome. I like the video and learning more from you. Thanks for that wonderful video. I share your videos with my students 😀 keep it up. Thanks Nicholas
@NicholasRenotte
Жыл бұрын
Thanks so much @Hanem!!
Thanks for looking into this particular field!
@NicholasRenotte
Жыл бұрын
Anytime @Fustigate!! glad you enjoyed it!
Hei bro, the link was for the Titanic and not for the Stable.
I like how you deliver the content. Good job dude
I enjoy your videos Nick! Thank you so much for the hard work and sharing
Bravo Brave coach!! Some of us might be needing a slow step by step explanation, so as to be on the same page
@NicholasRenotte
Жыл бұрын
🙏 🙏 🙏 will probably do a walkthrough on a live stream!
@yusufhenry9365
Жыл бұрын
@@NicholasRenotte that would be much appreciated by the community Thank you Sir!
@yusufhenry9365
Жыл бұрын
@@NicholasRenotte that would be much appreciated by the community Thank you Sir!
Yeahh finally you did it! I'm curious about where you learn all bunch of stuff? What are your recourses? How long preparation it takes to make a tutorial video for example?
@NicholasRenotte
Жыл бұрын
A lot of it is just random googling and reading! I normally give myself one to two days to learn the code and then a day to do the challenge and record.
@ahmetcals3651
Жыл бұрын
Keep going what you doin! Learning a lot from you :)
Such a Great idea and execution sir, big help for the project 🙌✨
This is awesome. But I agree with some of the comments that I wish you would slow down and just reach this stuff. It’s awesome and we can follow along. But while you are an awesome coder … your an even better educator
I enjoy this very much. I didn't know we can Text To Image in this way.
@NicholasRenotte
Жыл бұрын
🙏🙏🙏 pretty cool right?!
Also, would be interested in a discord bit code that episode! lol
Astonishing brother, learned many things, Could you please share how you got the image text pairs dataset Also please tell me which one is better STABLE DIFFUSION or GAN
Hey Nick, awesome tutorial! Do you know if it's possible to do this same thing using Intel CPUs? I've tried specifying 'cpu' as my device but am getting some errors.
Woah!! That's incredible. Great as always.
@NicholasRenotte
Жыл бұрын
Thanks a mil @Prabhu!
I couldn't find the module "authtoken" to install. Which is the link to it?
@NicholasRenotte
Жыл бұрын
Check out the Github repo, I updated it to show how to set it up!
@jerrycheng8537
6 ай бұрын
where in repo? sorry I cant find it
Hey, Nick, Great Video. Learned something new! I've a question, Is there any way to do it, if you don't have a GPU support on your pc???
@NicholasRenotte
Жыл бұрын
You can definitely do it, it'll just take a lot longer to generate!
getting an error in line number 18 the error is prompt = ctk.CTkEntrym(height=40, width=512, text_font=("Arial", 20), text_color="black", fg_color="white")
@rajjatkaul3539
Жыл бұрын
Text_font = only use font
Can you make a Traffic Sign Detection video next time sir? I really appreciated all of your works. Thank you.
@NicholasRenotte
Жыл бұрын
You got it!
which extension need to install please tell full setup like how you create stable bud and how we publish file
Love your content, keep it up brotha 💎
@NicholasRenotte
Жыл бұрын
SATORI DIGITAL!!! Thanks a million for checking it out :)
Congrats on completing it! Another cool video. I think you are a bit harsh to yourself - i mean loading the model etc shouldn't "consume" the time :D
@NicholasRenotte
Жыл бұрын
Hahahaha, true, I think I just get too hyped up in the moment and forget to pause and do stuff. I completely forgot to turn on the RGB lights on my desk as well normally they're the red and blue ones from prev code that challenges
This is very entertaining and exciting content, thank you so much for sharing such great work with us
In this episode, a text-to-image generation app using stable diffusion and P kinter is built with a 15 minute time limit. Dependencies are imported and an app is created. ✦ Build a text-to-image generation app using Stable Diffusion and P kinter 00:00 ✦ Create a UI using stable diffusion pipeline and tkinter 02:06 ✦ Creating a placeholder for an image and a button 04:27 ✦ Creating a generate function and configuring text for a button 06:40 ✦ Setting up and using a GPU for image generation 09:06 ✦ Working on GPU for space trip landing. 11:16 ✦ Generating text with deep learning models 13:58 ✦ Create and save 3D images with open source software. 16:54
Thank you so much for sharing your knowledge with us. I have learn so much from you.
Please help me! Exception has occurred: TypeError __init__() missing 1 required positional argument: 'master' File "/home/asdwa/Python/Ki/BilderKi/StableDiffusionApp-main/app.py", line 17, in prompt = ctk.CTkEntry(height=40, width=512, text_font=("Arial", 20), text_color="black", fg_color="white")
@saswatrath4646
Жыл бұрын
before height just type master = app, height = 40, ...... continued
This is called Stable diffusion SOTA model
Hello there , amazing tutorial , but i have a question that i am stuck with , what is the Auth_Token in the api file , is it python auth token for the enviroment or what ? I have been away from Python for a while now , so i am confused i would appreciat your hlep , cheers
He Nicholas! Thanks for your great videos, it would be awesome if you made a video about making your own difussion model.
Amazing stuff man. You did it within the time frame! Let's celebrate with an amazon gift card 😂
@NicholasRenotte
Жыл бұрын
I was soooooo tempted to just give it away for fun @Wesley!! Might add it to the pot for the next one?!
@wgb-10
Жыл бұрын
@@NicholasRenotte Nah its fine 😂
Hey Nick you are awesome man. I have learned so many crazy things from you. Can this will run on CPU?
@NicholasRenotte
Жыл бұрын
Thanks a mil @Daud! Sure can it'll just take longer to generate.
Woh You are Amazing And your content is massive ❤ everyone is Impressed When you challenge yourself for building new things in less time with accuracy I want this type of confidence to improve myself and Do something new 😌thanks Nic for providing a lot of knowledge craziness about ML and AI ❤️😌 it will help us
@NicholasRenotte
Жыл бұрын
I'm so glad you enjoyed it @Vivek!! Also love that you love my slight craziness LOL, gotta keep it fun!!
@viveknath6073
Жыл бұрын
@@NicholasRenotte yehh bro please provide this type contant i love it brooooh
Awesome Nick👍👋👋 maybe u can generate that Mercedes win an F1 race😉
@NicholasRenotte
Жыл бұрын
LOL you’re breaking my heart Henk 😂 maybe next season?! or the one after that?!
Have a question If I learn ai will I be able to learn ethical hacking at same time
@NicholasRenotte
Жыл бұрын
I don't know too much about ethical hacking but given enough time I guess you should be able to!
Can any one tell me how i can use speech recognition in React Native
That was really inspiring. I learned a lot from this video and I hope everyone else do too.
I am not able to connect the cuda n pytorch.. Struggling since hours to get that done.. Please help me
it's show like this( Potential NSFW content was detected in one or more images. A black image will be returned instead. Try again with a different prompt and/or seed.)
there is a error display while running the code torch not enabled with cuda can anyone help with this....plz
AssertionError: Torch not compiled with CUDA enabled. I am getting this error can you pls help me.
@orionnettuno7443
Жыл бұрын
cuda relates to nvidia graphics cards, you can change it to "cpu" instead
Hi, i tried this and i have one error, i honestly installed all the packages, but it gives me the error that the master argument is missing
@rajvinus
Жыл бұрын
do you have nvdia driver ?
@pavwlik
Жыл бұрын
@@rajvinus No.
@rajvinus
Жыл бұрын
@@pavwlik which graphics card you have in your pc
@pavwlik
Жыл бұрын
@@rajvinus amd rx6750XT, i have newest drivers.
Thanks for this great content.Which version of python was used for this project?
I am a lot confused with the virtual environment and global enviroments in pyhton, it is becoming so hard to import a specific verison of a module in a pyton project. Please make a video on working with virtual enviroments and how to keep them usefull everytime like you as a pro.
congrats for completing this lol....but howdo you make those text animations also
@NicholasRenotte
Жыл бұрын
LOL a ton of final cut pro and After Effects 😅
Thanks a ton ❤
Amazing! I almost thought that you gonna lose this challenge. lol.
@NicholasRenotte
Жыл бұрын
LOL for once I was like nottt todayyy!
hey, it is showing me the error no module named customtkinter
Hello sir i am not able to inastall authtoken and costumtkinter please someone should help me out
Amazing video as always… I’m not able to install some of those libraries while following the video.. where to find Authtoken?
@NicholasRenotte
Жыл бұрын
1. Create a new python file called authtoken.py 2. To that add a variable called auth_token 3. Get your user token from hugging face and set the auth_token variable to that value Should look like this auth_token="ahjkhkjhkh
@habs795
7 ай бұрын
What are the basic software requirements for this project? Can you share the instructions?
The video is amazing. learned a lot. Thanks for making it.
Hey Nick! I watched your video and I really like it. However, I have a problem with cuda. The error is "out of memory". Can you help with it, please? I've already checked a lot of websites to solve it,but nothing helped.
Hey @Nicholas Renotte, Thank you for this model. Its interesting how you were able to complete within 15 min. I tried this model on my system but got into few errors. Searched on Stackoverflow and on your github repo but did not find help. Could you please help with this error. Error: Potential NSFW content was detected in one or more images. A black image will be returned instead. Try again with a different prompt and/or seed. If anyone else know how to resolve. Let me know. Danke.
@user-ol3sz4km6j
3 ай бұрын
hey got same error ..did you find the way to overcome?
Great video Nicholas. What specifications do you advice I look for in a laptop I can use for about two years as a beginner in DL? I'm looking to get a hp pavilion 16gb RAM 512 gb SSD (or 1 tb SSD) Ryzen 7 5600h RTX 3050ti Do I need to be concerned about screen specifications? Are these specs good enough?
@NicholasRenotte
Жыл бұрын
Screen specs don't matter too much, but the GPU does if you want to get into deep learning! In a laptop you'll kind of be a little limited either way but a 3050ti is a great start!
@jeaywilson2168
Жыл бұрын
@@NicholasRenotte Thanks, I was also hoping that perhaps I could use cloud services like paperspace, that'd suffice right? I just have a lot of questions, and being a novice I'd appreciate if you could guide me on my journey. Can I follow you socials, like twitter?
He already coded this earlier so he already knew everything...
@mikesurong7315
Жыл бұрын
Remember criticisms make u stronger and hungrier
@Nicholas Renotte So the error is in 3.4 Build train and test Partition after I wrote res = preprocessing_twin(*example) I got a type error= preprocessing_twin takes 2 positional arguments but 3 were giving
@primz01
Жыл бұрын
So pls how do I fix the error thanks
Hello there was an error where it showing no module found named authtoken
bro your big brain I have a question how do you know to work with which liberay in .py
@NicholasRenotte
Жыл бұрын
A lot of it is research and experimentation!
good work king, love you
Hi Nicholas , what changes should we make to make it run on CPU ? Thank you
@adamalazzawi
Жыл бұрын
device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu") I guess
Hello Nicholas, please build an app that can generate a talk video from an image and text like in D-ID. Thank you very much. Your work is awesome, I can learn a lot.
Congrats you did it man🎉🎉🎉🎉
@NicholasRenotte
Жыл бұрын
WE did it!! Thanks a mil @huzi!!
@huzi46
Жыл бұрын
@@NicholasRenotte really love the work you put in with ur vids, keep it up man you’re doing an excellent job ❤️
Nick, your videos are amazing, but I was wondering if you would be willing to release the requirements.txt for the environments you run? I was able to follow the instructions of this challenge but then I face an error where torch says it is not compiled with cuda. I would like to make sure my versions are stable, and utilizing the requirements you have would help in troubleshooting.
@NicholasRenotte
Жыл бұрын
Just added it to the github repo for you! Let me know how you go.
@jgvisk1041
Жыл бұрын
@@NicholasRenotte Wanted to reply back that the requirements did the trick! I had an issue with torchvision, and your requirements.txt helped me troubleshoot how to properly install it. Thank you. Please consider releasing the requirements when you do future projects, and possibly past ones if you don't mind. I haven't been able to complete the TFOD course due to continuous errors on dependencies, even beyond the error handling you included, and don't know where to properly troubleshoot. Having a perspective of the environments you run in and version of python helps a great deal.
@habs795
7 ай бұрын
Can you share the instructions please?
Hey Nick how can I run this code in the CPU without GPU, when I am trying to run code in the CPU getting a lot of errors can you create a video on how we can run it on the CPU
Good but how to create 3d realistic image without using api and other website using this type ai model code
You are great, God bless you and continue to give you wisdom
Hello Nicholas, Can you please make a video on recurrent yolo on any custom data.. please 🥺🥺🥺
@NicholasRenotte
Жыл бұрын
Recurrent YOLO? That's a thing? Let me take a look!!
@squadgang1678
Жыл бұрын
@@NicholasRenotte yes It would be helpful for me if you make a video on it ✌️ we can use it to predict next frame of an moving object in video.. or if possible make a video any model which could predict next frame. For example if there is a man running on the road and you are tracking his motion if any object like a pole or a car comes in front of it a normal object tracking model wont detect the person whereas a next frame prediction model would predict its location
Love these challenges!
@NicholasRenotte
Жыл бұрын
🙏🙏🙏
Which python Version does it need and is it mandatory a GPU computer to run this or installing torch without GPU option will be okay also it can't import many classes what shall I do please help me out?
RuntimeError: "LayerNormKernelImpl" not implemented for 'Half' if anyone knows how to resolve this please help
This made my day!!! Thanks a lot!
@NicholasRenotte
Жыл бұрын
Thanks a mil for watching it @StarDust, ya made my day tuning in!!
Is there a way I can change the batch size? I have 4GB ram but 512MB is the additional requirement as I have 1650Ti Any help please
Hi Nick, I am getting the below error : prompt = ctk.CTkEntry(height=40, width=512, text_font=("Arial", 20), text_color="black", fg_color="white") TypeError: CTkEntry.__init__() missing 1 required positional argument: 'master'
@orionnettuno7443
Жыл бұрын
I also go that error, trying to figure it out TypeError: CTkEntry.__init__() missing 1 required positional argument: 'master'
@Kshitij-dr7qe
Жыл бұрын
Hi Souradeep, you need to enter master=app argument as per the documentation of customtkinter. This is how i did and it worked for me ``` prompt = ctk.CTkEntry(master=app, height=40, width=512, text_color="black", fg_color="white") ```
@souradeepsaha6944
Жыл бұрын
@@Kshitij-dr7qe Thank you for the reply. I will check and let you know
@areejsiddiqui6706
7 ай бұрын
Hi, I'm getting the same error, were you able to solve it? I'm guessing it has something to do with stabletk , it's the virtual environment ig?? Please reply
Hi) Did you download the AI model beforehand or you just connected with API?
you're my role model
Hey NIck. While checking your project i ran into few issues which python version have you used I'm currently using 3.6.0
Can I use API JSON which I fetch or extract it from a video instead of text?
@NicholasRenotte
Жыл бұрын
Would likely be a different use case if trying to pass in video or a frame as an input!
What was the terminal use
How to make it work using device="mps", since I am working on MacOS and CUDA is not enabled
I liked this. Is it possible to use my picture and mix with Ai scenes using this approach? Signing a big fan.
@NicholasRenotte
Жыл бұрын
Apparently it is: huggingface.co/spaces/fffiloni/stable-diffusion-inpainting i haven't tried it yet though @Geraldo!
well done ! thank you for sharing this !
@NIcholasRenotte can u help me with this error raise err OSError: [WinError 126] The specified module could not be found. Error loading "C:\Users\Admin\Desktop\My Files\Projects\ML Project\StableDiffusionApp\.venv\lib\site-packages\torch\lib\fbgemm.dll" or one of its dependencies.
Hey Nick i just completed coding it but when I run a pytorch_bin file is being downloaded....is it necessary to download it as you didn't downloaded it
I am getting init error in entry label and button it is asking for master can someone please tell what to do
That was exhilarating!
Hahahah best video Ive seen about python, fun anxious and exciting!!
Inspirational 🔥