Prompt Engineering - Part1 : Prompt Tricks You Probably Missed for Stable Diffusion

Фильм және анимация

I am back from a break from the channel! After taking the QA job at Stability (the company that makes stable diffusion) I needed to balance life and work, so needed to take a break. However, now that convention season is pretty much at an end, I can get things back on the road! This week I wanted to cover some AI prompt engineering tricks I don't see people using that are a core part of my workflow. Today we are working with the concept of allowing the prompt to be changed as it is inferenced (known as the FROM:TO:WHEN method), so we have a lot more control over the scene that we do with just prompting. This is just part one, as there are some other things I use that I also don't see out and about, so we are going to fix that. Cheers, and it is good to be back!
#stablediffusion #automatic1111 #aiart
Is your PC a potato? Use Run Pod for pennies an hour: tinyurl.com/ydu6rkpk
Print and sell your own artwork! tinyurl.com/22qwnrqu
Join my Discord server! Do it! / discord
Twitter: / sedetweiler
Instagram: / sedetweiler

Пікірлер: 104

  • @SouthbayCreations
    @SouthbayCreations Жыл бұрын

    This is exactly what the community needs! Back to basics, well sorta. Expanding on the tools we already have. Everyone (including myself) are quick to jump on a new tool/extension but then we forget about all the other cool stuff we already have. Great video! Welcome back!

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Thank you! I also felt that some of these amazing tools had uses we just kinda skipped over. I will try and hit those as I also work on the bleeding edge of things. Cheers!

  • @timothymaggenti717
    @timothymaggenti71711 ай бұрын

    Fantastic, great job, thanks. This is the first time I understood how the prompt process works. I am new to all this and finally the light came on. 🎉

  • @MonzonMedia
    @MonzonMedia Жыл бұрын

    The master has returned! Congrats on the job with Stability! Your install video is what got me into auto1111 and I've since fallen down the rabbit hole! Long story short, started covering AI platforms, mostly online....ended up with a job with one of them 😁 you were one of the many sparks that led me down that path. Thank you Scott! Oh and yes, looking forward to part 2!

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Dude! That is amazing, and I am so happy for you! Just imagine where all of this will be a year from now, as a year ago we would not have even dreamed this was possible. So happy for you!

  • @MonzonMedia

    @MonzonMedia

    Жыл бұрын

    @@sedetweiler indeed! It’s progressed so much. It’s been a fun journey so far. Again can’t thank you enough my friend and I’m super stoked for you as well! Here’s to more growth and opportunities to come! 🍻🙌🏼

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    We have a lot of new goodness coming out soon. Not going to be lacking content any time soon. Cheers!

  • @ThoughtFission
    @ThoughtFission Жыл бұрын

    yours are the most useful videos I've come across so far. Direct, to the point and easy to understand. Not always the case with AI tutorials.

  • @sedetweiler

    @sedetweiler

    11 ай бұрын

    Thank you!

  • @KiZzymesl
    @KiZzymesl Жыл бұрын

    welcome Back !! and thank you for dropping those gems, I didn't know this technique !

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    More to come! I am glad it wasn't old news. :-)

  • @charb423
    @charb423 Жыл бұрын

    I love this video, I just got started and up and running with Stable Diffusion so I appreciate these tips! Congratulations on your position at Stability! New subbie❤❤❤❤❤

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Awesome! Thank you!

  • @jankvis
    @jankvis Жыл бұрын

    Nice to see you back and thx for the tutorial, cheers :)

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Hey, thanks!

  • @itdreamsme
    @itdreamsme Жыл бұрын

    So happy you're back!!!! 🙌

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Yay! Thank you!

  • @clifforderskineart
    @clifforderskineart Жыл бұрын

    He has returned!! Glad to see you back

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Thank you! It is good to be back!

  • @alex-ender
    @alex-ender Жыл бұрын

    Scott, don't leave us for so long. I was starting to get worried. Thanks for the awesome video.

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    It's a deal! I had a bit too much on my plate and have since learned to balance a bit better. More videos will keep on coming. Cheers!

  • @clairearcher2549
    @clairearcher2549 Жыл бұрын

    This was very helpful. Thanks Scott!

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Very welcome!

  • @LoneRanger.801
    @LoneRanger.801 Жыл бұрын

    This is such an awesome video. I learned something new today. Thank you.

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Glad you enjoyed it! Cheers!

  • @themonotropicguitarist
    @themonotropicguitarist Жыл бұрын

    Awesome! Thanks for this info. I feel like I need a little cheat sheet of all these tricks. Maybe an idea for those who know the ins and outs of them all.

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Not a bad idea!

  • @davewaldmancreative
    @davewaldmancreative5 ай бұрын

    Dude. your guides are super cool :-) many thanks

  • @sedetweiler

    @sedetweiler

    5 ай бұрын

    Glad you like them!

  • @10master31
    @10master31 Жыл бұрын

    Very informative video, waiting for part 2...

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Coming soon

  • @sikknikk100
    @sikknikk10010 ай бұрын

    Excellent video and tutorial 👍😎👌

  • @sedetweiler

    @sedetweiler

    10 ай бұрын

    Thank you 👍

  • @randymonteith1660
    @randymonteith1660 Жыл бұрын

    Love the new tricks you taught in this video! I do have a question though? What is that Heading you have called " Stability API Settings " ?

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    I will cover that in a video soon. It is an extension.

  • @OriBengal
    @OriBengal Жыл бұрын

    Very useful. Thanks!

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Glad it was helpful!

  • @LouisGedo
    @LouisGedo Жыл бұрын

    Welcome back!

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Thanks! :-)

  • @royceahr
    @royceahr Жыл бұрын

    Well presented...

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Thank you 🙂

  • @coloryvr
    @coloryvr Жыл бұрын

    Thank you very much for that video! Although I've been using SD since release, the complexity is often confusing now.... Anyway: Many thanks to Emad Mostaque and everyone at SD for the free open source version! To me, Local SD is a tremendous gift to humanity! And if my art was used for "training": It's an honor! Happy colored greetinx

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Glad it was helpful!

  • @hatuey6326
    @hatuey6326 Жыл бұрын

    very useful thanks !

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    You're welcome!

  • @blackvx
    @blackvx Жыл бұрын

    Hey, i remember you!Welcome back😊

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    hehe! Thank you!!!

  • @WiLDeveD
    @WiLDeveD Жыл бұрын

    Pure Content. thanks. what brand and model is your GPU ?

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Thank you! I have an Nvidia 3090 TI.

  • @davedm6345
    @davedm6345 Жыл бұрын

    wow i lose all my time experimenting with the SD web guide with percentages to merge two tings LMAO, you make it more simple thanks!. I was having lot of problems putting camera angles and negative prompts as an example: car front or front view i do not want and i ended with lots of car front Photos :( it's ridiculous why? sometimes the text broke or some in the interpretations broke the line and end without the merged texts. Can you make a video to control camera angles in the prompts? THANKS NEW SUB!

  • @amorgan5844
    @amorgan58443 ай бұрын

    Did you ever start a podcasts? Im hoping so, just found the channel and have been binge watching

  • Жыл бұрын

    Welcome back! I have learned a lot from you, I hope I will continue to do so in the future!

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Glad to hear that! I have a lot to pass on that I have learned since starting at Stability.

  • @Arewethereyet69
    @Arewethereyet6911 ай бұрын

    thanks, need more!!! lol

  • @GerryLouis1
    @GerryLouis16 ай бұрын

    🎉🎉🎉good learning

  • @alexwan811
    @alexwan811 Жыл бұрын

    I humbly grovel to thee!! thanks!

  • @rahulchakraborty4770
    @rahulchakraborty477011 ай бұрын

    Hey Scott! Really love your content! I am a Stable diffusion enthusiast like yourself. I really want to take this seriously and want to make this as my career. Can you please give me some tips of how to find a job at StabilityAI or any other company with specialization in Stable Diffusion and AI? Thank you.

  • @sedetweiler

    @sedetweiler

    11 ай бұрын

    Just master the aspects you enjoy and become an expert that someone will see as a benefit. That pretty much works for and career, but the important part is making sure it's something you enjoy.

  • @merek1
    @merek1 Жыл бұрын

    Woooooo! Missed your videos. Glad to see you back.

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Thank you! It is good to be back.

  • @generalawareness101
    @generalawareness101 Жыл бұрын

    Welcome Back.

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Thank you! It is good to be back.

  • @Nitrowing1500
    @Nitrowing1500 Жыл бұрын

    Yeah, I knew none of this! Thank you.

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Happy to help!

  • @IlRincreTeam
    @IlRincreTeam Жыл бұрын

    Hey, where did you get that Clip Guidance tool? Does not seem to be available in any extension for Auto1111

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Which one? Sorry, I thought I had most of those things turned off for the tutorial so I didn't complicate things.

  • @IlRincreTeam

    @IlRincreTeam

    Жыл бұрын

    @@sedetweiler Below the sampling steps there is a box to tick saying 'clip guidance', I'm sure that most of the initiate to expert users of Stable DIffusion would like to know ;)

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Ahh, that is related to using the dreamstudio sapi connection. You can use that and a few other options to have the inference completed on our huge GPU cluster rather than the local GPU. It also opens up other models we host there, and I will do a video on that soon as well. Cheers!

  • @fatenathan
    @fatenathan Жыл бұрын

    how did you get the pink overlay?

  • @muledeer1766
    @muledeer1766 Жыл бұрын

    Is there something similar to the square brackets [ : ] prompt in ComfyUI ? or does it work there?

  • @teambabaganoush7035

    @teambabaganoush7035

    Жыл бұрын

    youre wondering how to engineer on a Mac interface? and the manner to do so?

  • @kkbbxx
    @kkbbxx Жыл бұрын

    would combining 3 or more ideas also work, [car|plane|ship|bike]?

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Yes, you can do as many as you like.

  • @adumont
    @adumont6 ай бұрын

    Is it front-end/tool specific? Does it only work in Automatic1111, or is it more generic and would work on other SD tools like Fooocus?

  • @TheSporkimusPrime
    @TheSporkimusPrime6 ай бұрын

    Can you do [from : to : when] in Fooocus in any way?

  • @aifreeart
    @aifreeart Жыл бұрын

    Is it only possible on model v1.5-ckpt? Not in other models

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Works on any model.

  • @Klaaninka
    @Klaaninka8 ай бұрын

    Loved this revelation. Thanks! Only thing is: Where did the pirate ship come from at 4:47. Also, at 6:16, you state that the 2nd bracketed item, the pirate ship, is rendered for the first 20% of the render. Don't you mean that the race car is rendered for the first 20%? Fully clarified later though!

  • @sedetweiler

    @sedetweiler

    8 ай бұрын

    Glad you enjoyed it, and thank you for the support on the channel!

  • @TheDanEdwards
    @TheDanEdwards Жыл бұрын

    Your use of "brace" for the character "[" took me off-guard initially. In my math (and comp sci) classes we always called that a "bracket", with "brace" being used for "{". Anyway, the lexical tricks you show are for automatic1111, correct? Other UIs may or may not work the same way, yes?

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Ahh, you are correct! Yes, as far as I know each piece of software has their own "standard." :-(

  • @metronome003
    @metronome00311 ай бұрын

    Does these also work with comfy UI?

  • @sedetweiler

    @sedetweiler

    11 ай бұрын

    Yes, as that is just a front end to the models.

  • @TKPaulChan
    @TKPaulChan10 ай бұрын

    Does this feature exist in ComfyUI?

  • @sedetweiler

    @sedetweiler

    10 ай бұрын

    Yup!

  • @lioncrud9096
    @lioncrud909610 ай бұрын

    does this work in comfy

  • @sedetweiler

    @sedetweiler

    10 ай бұрын

    It's actually better in comfy. Video coming soon!

  • @tauseefahmedmemon9148
    @tauseefahmedmemon9148 Жыл бұрын

    What site is he using?

  • @RamonGuthrie
    @RamonGuthrie Жыл бұрын

    Does this same technique work with two different people LoRAs and could I blend two peoples faces to create unique faces?

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    I would imagine so, as it is simply layering the results.

  • @masterzed1
    @masterzed1 Жыл бұрын

    another headache... 😢.. but i understand ... ty....

  • @riverrat_uk
    @riverrat_uk5 ай бұрын

    hi scott, how do i add say people in the backround? say a night club,

  • @QVsense
    @QVsense Жыл бұрын

    its very nice, but the title said trickS i only seen one trick

  • @sedetweiler

    @sedetweiler

    Жыл бұрын

    Did you watch the entire video? There are several here, including the use of the | without a when? parameter, using the blank :: and using the : without a start.

  • @QVsense

    @QVsense

    Жыл бұрын

    @@sedetweiler yes iv seen it to the end, for me it was one trick with some variations or sub parts. but that was kinda knitpicking on my side, its a good video

  • @97BuckeyeGuy
    @97BuckeyeGuy6 ай бұрын

    Too bad the developer of ComfyUI refuses to support this prompt trick.

  • @sedetweiler

    @sedetweiler

    6 ай бұрын

    There are nodes that let it work.

  • @97BuckeyeGuy

    @97BuckeyeGuy

    6 ай бұрын

    @@sedetweiler Are you talking about CLIP Text Encode++? Because that doesn't seem to work correctly, either.

  • @MattJonesYT
    @MattJonesYT Жыл бұрын

    Starts at 1:22

Келесі