"okay, but I want GPT to perform 10x for my specific use case" - Here is how

Ғылым және технология

Finetune Falcon 7b/40b instruct with your own data - The step by step guide about how to train falcon model for generating high quality midjourney prompt, from prep training dataset to comparing final results;
- Join Falcon 40B contest: falconllm.tii.ae/call-for-pro...
- Follow me on twitter: / jasonzhou1993
- Join my AI email list: www.ai-jason.com/
- My discord: / discord
🔗 Links
- Google colab: colab.research.google.com/dri...
- Midjourney training dataset: docs.google.com/spreadsheets/...
- RelevanceAI midjourney training dataset generator: app.relevanceai.com/notebook/...
⏱️ Timestamps
0:00 Finetune VS Knowledge base
1:50 Step1 Choose base LLM
2:30 Step2 Prep training data
4:54 Step3 Setup google colab
5:41 Step4 Load base Falcon model
6:48 Step5 Load training data
7:36 Step6 Finetune model
7:56 Step7 Save & run finetuned model
9:08 Falcon 40b
👋🏻 About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! ask@ai-jason.com
#gpt #autogpt #ai #artificialintelligence #tutorial #stepbystep #openai #llm #falcon7b #finetune #largelanguagemodels #largelanguagemodel #midjourney

Пікірлер: 593

  • @trickybarrel444
    @trickybarrel4449 ай бұрын

    No clickbait, no long intro, no over-excitement. Just pure, straight-to-the-point content, with real-world examples and neatly divided sections. You are a hero

  • @668771

    @668771

    9 ай бұрын

    You understood that? I wish.

  • @Bashar3A

    @Bashar3A

    9 ай бұрын

    YES! Getting tired of those time filler AI videos, almost didn't watch this one. Now subscribed

  • @myob3074

    @myob3074

    8 ай бұрын

    Aaaah just like the good ol days 😅😂

  • @myob3074

    @myob3074

    8 ай бұрын

    ​@@668771knuckle down and study practice study practice, it's not that difficult 🤷🏽‍♂️

  • @Andyonrice

    @Andyonrice

    7 ай бұрын

    specific use case: filter videos for overexcitement and clickbait, then tag them

  • @spoonikle
    @spoonikle10 ай бұрын

    holy heck dude, you just taught us magic. This is the magic! not even the fine tuning, but the data set generation! data sources! all the pieces I have been searching for!

  • @AIJasonZ

    @AIJasonZ

    10 ай бұрын

    Thanks so much mate!! That means a lot, DM me if you get any question pls!

  • @EGGHEADIUS

    @EGGHEADIUS

    9 ай бұрын

    Literally brother you have taught us prompt engineering wizardry, there’s no other way to put it.

  • @DeepDiveNFT

    @DeepDiveNFT

    9 ай бұрын

    I’ve been generating massive data sets and manipulating in python then bringing it back to fine tune. Shits getting wild out here

  • @Zer-ei4co

    @Zer-ei4co

    9 ай бұрын

    @@DeepDiveNFTlol sounds like fun, what kind of general use cases do you have?

  • @stan9682

    @stan9682

    9 ай бұрын

    Be wary that OpenAI prohibits the use of their models to generate training data (no competing closure). It's hard to detect, obviously, but it's useful knowledge imo regardless.

  • @pikleman5880
    @pikleman58808 ай бұрын

    Honestly, I love how you don't put a clickbaity title or thumbnail, and how you explain it well but also fast.

  • @sweetmelon3365
    @sweetmelon336510 ай бұрын

    Very good teaching style. I also liked that you actually went through the process ourself. Thank you very much

  • @sayantandas7544
    @sayantandas754410 ай бұрын

    One thing I really like about your videos is that it always comes with really quality examples. And the examples are pretty much practical oriented. Do make the embedding video.

  • @AIJasonZ

    @AIJasonZ

    10 ай бұрын

    Thanks man, that means a lot! 😬

  • @treadaar

    @treadaar

    9 ай бұрын

    @@AIJasonZ Absolutely agree. Very helpful and i like the speed you go, staying on topic. Please make the embedding video! Very interested to see your take on it.

  • @668771

    @668771

    9 ай бұрын

    I thought the opposite, this was like watching someone assemble a nuclear reactor. I'm more confused about AI after watching this. You need to be a master programmer to properly view this video.

  • @antonschillen2633

    @antonschillen2633

    21 күн бұрын

    @@AIJasonZ +1 on make the embedding video. Really great stuff :)

  • @hansjochen2193
    @hansjochen21938 ай бұрын

    One of the best and most straight forward tutorials i have Seen after 5 years of ComputerScience! Keep it up now i am honna binge eatvh your other videos

  • @DivineMisterAdVentures
    @DivineMisterAdVentures9 ай бұрын

    Really appreciate your free thought. Will try to follow you closely.

  • @loktheswe6768
    @loktheswe67689 ай бұрын

    Omg this is the best one I have seen so far!!!I’m planning to train one of my own model soon!!

  • @lucyn.7501
    @lucyn.750110 ай бұрын

    Fantastic video once again, can’t wait for the next embedding one 😊

  • @squibtechnologies
    @squibtechnologies7 ай бұрын

    I'm floored by your content. It is amazing 👏👏👏👏👏👏

  • @kazimafzal
    @kazimafzal9 ай бұрын

    Bloody awesome video - concise yet detailed! Looking for upcoming vids

  • @unshadowlabs
    @unshadowlabs9 ай бұрын

    Great Video! I would love to see a video on how to create an embedded knowledge base and use it along side this fine-tuning.

  • @tahamohd1409
    @tahamohd140910 ай бұрын

    I'm glad i found this channal! wonderful work!!

  • @AdrianMark
    @AdrianMark9 ай бұрын

    Learning so much from you. Thank you for making this.

  • @maxgeorgopoulos3516
    @maxgeorgopoulos35167 ай бұрын

    Awesome video! So many great resources. Demystified a lot for me. Thanks!

  • @soyitiel
    @soyitiel9 ай бұрын

    Your audio gradually went from studio recording to cathedral ambiant. Hey thanks for the info. Love it ♥

  • @joejiang8353
    @joejiang83539 ай бұрын

    Excellent video Jason! Step by step examples are really helpful

  • @DorkDork69
    @DorkDork696 ай бұрын

    Man this is exactly the sort of guide I was looking for. Thank you very much.

  • @LC-lj5kd
    @LC-lj5kd10 ай бұрын

    well done! looking forward to the embedding video too

  • @dogemaster6361
    @dogemaster636110 ай бұрын

    Excellent video Jason. Well organised and easy to understand.

  • @chonmon
    @chonmon9 ай бұрын

    Good work dude! This is super useful!

  • @unicornist
    @unicornist6 ай бұрын

    most underrated channel in AI. Thank you for the effort you are putting into this.

  • @yashsoni5437
    @yashsoni54379 ай бұрын

    Great Video! Keep up the good work

  • @royxss
    @royxss9 ай бұрын

    This is just amazing! waiting for your embedding model

  • @antonschillen2633
    @antonschillen263321 күн бұрын

    Great content! A how-to without any fluff what so ever that is easy to follow.

  • @user-jt3jc7fk2x
    @user-jt3jc7fk2x10 ай бұрын

    keep the good job Jin Yang,your top follower from shanghai

  • @mytechnotalent
    @mytechnotalent10 ай бұрын

    Great job Jason! Very helpful!

  • @awesomeGuss
    @awesomeGuss9 ай бұрын

    brooo....God bless you for this...gained a ton

  • @Muuip
    @Muuip8 ай бұрын

    Great concise tutorial, thanks!👍

  • @khaledrweha6823
    @khaledrweha68237 ай бұрын

    Much appreciated ❤️ Thanks man, this helped me alot!

  • @mhc4124
    @mhc41248 ай бұрын

    This is fantastic info, thanks! Subscribed.

  • @Yadu-bv1kn
    @Yadu-bv1kn9 ай бұрын

    One of the best, to the point, goldmine of a tutorial

  • @jasonwang3539
    @jasonwang35398 ай бұрын

    Real thanks from another Jason man, clear and concise video! As a high schooler, I'd like to create an LLM project, so I hope I can follow through after I do my research :)

  • @user-jd3gf5xw1x
    @user-jd3gf5xw1xАй бұрын

    honestly, I was not expecting jin yang to teach us but I'm all for it straight to the point, loved it

  • @AnonymousBosch3158
    @AnonymousBosch31589 ай бұрын

    So useful! Thank you!

  • @JustRawFootage
    @JustRawFootageАй бұрын

    This is an amazing video that helps me make sense of the Azure Open AI playground to train my model. Love this.

  • @markmonfort29
    @markmonfort2910 ай бұрын

    Brilliant mate. Keep these coming

  • @user-vk5fj5mj8s
    @user-vk5fj5mj8s10 ай бұрын

    Good Job Jason 👨🏽‍💻

  • @BiranchiNarayanNayak
    @BiranchiNarayanNayak8 ай бұрын

    Excellent tutorial on finetuning Falcon 7B

  • @TheAiClub
    @TheAiClub10 ай бұрын

    Good stuff Jason🤙🏻

  • @chrismachabee3128
    @chrismachabee31289 ай бұрын

    Excellent lesson on Fine tuning. You are a good teacher. Thanks. Please make he next video I am now subbed.

  • @DavidPiccinelli
    @DavidPiccinelli8 ай бұрын

    this is gold, thank you!

  • @Trolosi123
    @Trolosi1239 ай бұрын

    Great video, dude! Thanks!

  • @user-cl5gh9pu6r
    @user-cl5gh9pu6r5 ай бұрын

    Awesome! I'm totally new to fine-tuning. I'm looking forward to fine-tuning a model with thousands of private 4K images!

  • @JayanaKalansuriya
    @JayanaKalansuriya9 ай бұрын

    What an amazing to the point video! You're an amazing human being Jason. Keep doing you!

  • @lucaswei9133
    @lucaswei913310 ай бұрын

    I like it. Because your video i can follow it every step. It's important for a newbine .

  • @indiecowan33
    @indiecowan336 ай бұрын

    Wow, what a sick video. Thanks so much!

  • @jasonfinance
    @jasonfinance10 ай бұрын

    Oh man, this is so good, i always confused about when should i finetune LLM, this makes things super clear; Also falcon 40b seem to be an awesome choice!

  • @DigitalMirrorComputing
    @DigitalMirrorComputing3 ай бұрын

    Absolutely loved the video mate! super focused! You inspired me for my own channel! thanks and keep it up! :))

  • @chaseclingman
    @chaseclingman10 ай бұрын

    Would love to see the video on the knowledge database. Thank you for this!

  • @loudorz
    @loudorz7 ай бұрын

    Great job !

  • @arfh2759
    @arfh27599 ай бұрын

    All thriller no filler. Wicked vid well done sir

  • @hughesadam87
    @hughesadam878 ай бұрын

    This is such a relevant and timely video. Thanks bud. PS I love all your silicon valley video titles

  • @michaelnurse9089
    @michaelnurse908910 ай бұрын

    I appreciate this. Subscribed.

  • @sup5356
    @sup53568 ай бұрын

    fantastically clear

  • @nsoe8990
    @nsoe89909 ай бұрын

    thanks for this amzaing videos. looking forwards to your next videos for embedded knowledge base and creating a chatbot for UI using these trained models.

  • @ryanfarran
    @ryanfarran6 ай бұрын

    I have been spinning my wheels on a project and this video unstuck me - thanks a million!

  • @wilfredomartel7781
    @wilfredomartel778110 ай бұрын

    Well explained my friend👏👏

  • @CustAndCode
    @CustAndCode8 ай бұрын

    really interesting! nice video! 🤗

  • @yelectric1893
    @yelectric18939 ай бұрын

    Beyond excellent. Damn. Reminds me of Yolo and Stable diffusion in a way. I have got to read the papers sometimes and try tot write a C implementation. This is beautiful!!!!!

  • @sohailhosseini2266
    @sohailhosseini22667 ай бұрын

    Thanks for sharing!

  • @serispeaks
    @serispeaks8 ай бұрын

    Bro you've done something wonderful for the world with sharing this video 🎉👏 As an app dev I learned something I didn't know I needed to know

  • @CloudWithUgur
    @CloudWithUgur7 ай бұрын

    give this man a cookie, dude thank you !!!!

  • @mlavinb
    @mlavinbАй бұрын

    Great content! thanks for sharing

  • @SafetyLabsInc_ca
    @SafetyLabsInc_ca6 ай бұрын

    Great video. Helped create a much tighter solution for our client.

  • @MYBLOODYUSERNAMEFFS
    @MYBLOODYUSERNAMEFFS9 ай бұрын

    Ey 😊 awesome. I created a conversational api with context management in Java. I've used gpt-4 and learnt allot. I'm hoping I can make use of this as well. Nice video.

  • @Blue-bd4vs
    @Blue-bd4vs9 ай бұрын

    my man great content ever, keep it up

  • @Hmelino
    @Hmelino8 ай бұрын

    Yes please, waiting for knowledge base embedding video ! 🎉

  • @MasterBrain182
    @MasterBrain1829 ай бұрын

    Astonishing content Man 👍👍👍

  • @dubey_ji
    @dubey_ji9 ай бұрын

    that was really good glad this was recommended to me

  • @AndrewsPanda
    @AndrewsPanda8 ай бұрын

    Amazing, thank you!

  • @juansebastiansandovalcorre9254
    @juansebastiansandovalcorre92549 ай бұрын

    Looking forward to the video on embedding a knowledge base

  • @martinskov5155
    @martinskov51556 ай бұрын

    Great video mate! Keep up the work (Y)

  • @parkjunu2400
    @parkjunu24008 ай бұрын

    you are legend tysm!

  • @joseinTokyo
    @joseinTokyo5 ай бұрын

    excellent tutporial! thank you for sharing.

  • @judysu8992
    @judysu89929 ай бұрын

    节奏好快,剪得厉害👍

  • @Gos2
    @Gos29 ай бұрын

    Wow this is amazing, pure relevant data, tahnk you!, you got my subscription and like

  • @Nono-ie3yk
    @Nono-ie3ykАй бұрын

    Hi, Thanks for the excellent video.

  • @davidconnelly
    @davidconnelly8 ай бұрын

    This channel is going to be huge.

  • @yush3402
    @yush34026 ай бұрын

    Amazing, you are the best bro. thanks

  • @nithinchinni
    @nithinchinniАй бұрын

    Great information. I am interested in the embedding style. Would love to see a video of that.

  • @joaopauloborges3866
    @joaopauloborges38665 ай бұрын

    Thanks for sharing such an amazing content! It would be great with you could also make a video about creating embeddings

  • @user-cn4co9mt4p
    @user-cn4co9mt4p2 ай бұрын

    really helpful and straight forward. Subbed !

  • @dreamingtulpa
    @dreamingtulpa9 ай бұрын

    Thank you for sharing this. This will definitely help. Also epic thumbnail 😂

  • @sparebatteries
    @sparebatteries10 ай бұрын

    great video Jason - also my first ever comment on KZread. Most practical tutorials on AI so far imo - I would be keen to see a video where you set up a vector DB and load your own data

  • @AIJasonZ

    @AIJasonZ

    10 ай бұрын

    Hah thanks, first comment means a lot to me! Will get more content :)

  • @mitchellsigley8574
    @mitchellsigley85749 ай бұрын

    Great video Jason.

  • @th3j0t46
    @th3j0t469 ай бұрын

    This was super informative and I learned a lot. Great video!! Not to be rude, see this as a constructive comment, be aware of some typos you have along the video. It's not like it bothers me much or anyone, but correcting those little details add up to make your content even better! Good luck and I hope to watch more of your videos :D

  • @chopradimpy
    @chopradimpy9 ай бұрын

    Thanks for sharing. It was helpful for understanding the fine tuning process. Can you also make a video on KnowledgeBase embedding? Thanks

  • @C3r3P0weL
    @C3r3P0weL8 ай бұрын

    Waw that was amazing

  • @wizarddon
    @wizarddon8 ай бұрын

    Thank you Jin yang

  • @ayushnayak6138
    @ayushnayak61382 ай бұрын

    I have been looking for you for so long. Thank you so much for this. Now I can ditch open AI api key and use this for free for my usecase.

  • @sameergamer4567
    @sameergamer45677 ай бұрын

    Damn amazing video

  • @raaajit1
    @raaajit14 ай бұрын

    Thanks for the detail level of explanation .....

  • @Neuronalchannel
    @Neuronalchannel9 ай бұрын

    Great! Thanks!

  • @DEFACTO9
    @DEFACTO98 ай бұрын

    Bad audio Dude. However, this is Exceptional content... finally... a workable explanation. Thank You.

  • @askolotus_prime
    @askolotus_prime6 ай бұрын

    awesome video man! thanks a lot :)

  • @SS-rt8oo
    @SS-rt8oo2 ай бұрын

    Great video, thank you

  • @NierAutomata2B
    @NierAutomata2B9 ай бұрын

    Great video! Subscribed!

  • @petarboskovic3519
    @petarboskovic3519Ай бұрын

    Great video buddy

  • @kyleroach2581
    @kyleroach25819 ай бұрын

    Well done

Келесі