What is Retrieval-Augmented Generation (RAG)?

Try RAG with watsonx → ibm.biz/BdMsRT
Learn more about RAG→ ibm.biz/BdMsRt
Large language models usually give great answers, but because they're limited to the training data used to create the model. Over time they can become incomplete--or worse, generate answers that are just plain wrong. One way of improving the LLM results is called "retrieval-augmented generation" or RAG. In this video, IBM Senior Research Scientist Marina Danilevsky explains the LLM/RAG framework and how this combination delivers two big advantages, namely: the model gets the most up-to-date and trustworthy facts, and you can see where the model got its info, lending more credibility to what it generates.
Get started for free on IBM Cloud → ibm.biz/sign-up-now
Subscribe to see more videos like this in the future → ibm.biz/subscribe-now

Пікірлер: 368

  • @xzskywalkersun515
    @xzskywalkersun5155 ай бұрын

    This lecturer should be given credit for such an amazing explanation.

  • @cosmicscattering5499

    @cosmicscattering5499

    3 ай бұрын

    I was thinking the same, she explained this so clearly.

  • @tariqmking

    @tariqmking

    2 ай бұрын

    Yes this was excellently explained, kudos to her.

  • @brianmi40

    @brianmi40

    Ай бұрын

    Or at least credit for being able to write backwards!

  • @victoriamilhoan512

    @victoriamilhoan512

    10 күн бұрын

    The connection between a human answering a question in real life vs how LLMs (with or without RAG) do it was so helpful!

  • @vt1454
    @vt14546 ай бұрын

    IBM should start a learning platform. Their videos are so good.

  • @XEQUTE

    @XEQUTE

    5 ай бұрын

    i think they already do

  • @srinivasreddyt9555

    @srinivasreddyt9555

    Ай бұрын

    Yes, they have it already. KZread.

  • @siddheshpgaikwad

    @siddheshpgaikwad

    29 күн бұрын

    Its mirrored video, she wrote naturally and video was mirrored later

  • @Hossam_Ahmed_

    @Hossam_Ahmed_

    28 күн бұрын

    They have skill build but not videos at least most of the content

  • @CaptPicard81

    @CaptPicard81

    25 күн бұрын

    They do, I recently attended a week long AI workshop based on an IBM curriculum

  • @natoreus
    @natoreus7 күн бұрын

    I'm sure it was already said, but this video is the most thorough, simple way I've seen RAG explained on YT hands down. Well done.

  • @ghtgillen
    @ghtgillen7 ай бұрын

    Your ability to write backwards on the glass is amazing! ;-)

  • @jsonbourne8122

    @jsonbourne8122

    6 ай бұрын

    They flip the video

  • @Paul-rs4gd

    @Paul-rs4gd

    3 ай бұрын

    @@jsonbourne8122 So obvious, but I did not think of it. My idea was way more complicated!

  • @jordonkash
    @jordonkash3 ай бұрын

    4:15 Marina combines the colors of the word prompt to emphasis her point. Nice touch

  • @geopopos
    @geopopos2 ай бұрын

    I love seeing a large company like IBM invest in educating the public with free content! You all rock!

  • @ericadar
    @ericadar5 ай бұрын

    Marina is a talented teacher. This was brief, clear and enjoyable.

  • @maruthuk
    @maruthuk7 ай бұрын

    Loved the simple example to describe how RAG can be used to augment the responses of LLM models.

  • @m.kaschi2741
    @m.kaschi27415 ай бұрын

    Wow, I opened youtube coming from the ibm blog just to leave a comment. Clearly explained, very good example, and well presented as well!! :) Thank you

  • @ntoscano01
    @ntoscano014 ай бұрын

    Very well explained!!! Thank you for your explanation of this. I’m so tired of 45 minute KZread videos with a college educated professional trying to explain ML topics. If you can’t explain a topic in your own language in 10 minutes or less than you have failed to either understand it yourself or communicate effectively.

  • @TheAllnun21
    @TheAllnun215 ай бұрын

    Wow, this is the best beginner's introduction I've seen on RAG!

  • @aam50
    @aam505 ай бұрын

    That's a really great explanation of RAG in terms most people will understand. I was also sufficiently fascinated by how the writing on glass was done to go hunt down the answer from other comments!

  • @GregSolon
    @GregSolon3 ай бұрын

    One of the easiest to understand RAG explanations I've seen - thanks.

  • @vikramn2190
    @vikramn21908 ай бұрын

    I believe the video is slightly inaccurate. As one of the commenters mentioned, the LLM is frozen and the act of interfacing with external sources and vector datastores is not carried out by the LLM. The following is the actual flow: Step 1: User makes a prompt Step 2: Prompt is converted to a vector embedding Step 3: Nearby documents in vector space are selected Step 4: Prompt is sent along with selected documents as context Step 5: LLM responds with given context Please correct me if I'm wrong.

  • @DJ-lo8qj

    @DJ-lo8qj

    28 күн бұрын

    I’m not sure. Looking at OpenAI documentation on RAG, they have a similar flow as demonstrated in this video. I think the retrieval of external data is considered to be part of the LLM (at least per OpenAI)

  • @PlaytimeEntertainment

    @PlaytimeEntertainment

    27 күн бұрын

    I do not think retrieval is part of LLM. LLM is the best model at the end of convergence after training. It can't be modified rather after LLM response you can always use that info for next flow of retrieval

  • @Lucildor
    @Lucildor3 ай бұрын

    Please keep all these videos coming! They are so easy to understand and straightforward. Muchas gracias!

  • @kingvanessa946
    @kingvanessa9463 ай бұрын

    For me, this is the most easy-to-understand video to explain RAG!

  • @projectfocrin
    @projectfocrin5 ай бұрын

    Great explanation. Even the pros in the field I have never seen explain like this.

  • @javi_park
    @javi_park3 ай бұрын

    hold up - the fact that the board is flipped is the most underrated modern education marvel nobody's talking about

  • @RiaKeenan

    @RiaKeenan

    3 ай бұрын

    I know, right?!

  • @euseikodak

    @euseikodak

    3 ай бұрын

    Probably they filmed it in front of a glass board and flipped the video on edition later on

  • @politicallyincorrect1705

    @politicallyincorrect1705

    3 ай бұрын

    Filmed in front of a non-reflective mirror.

  • @TheTomtz

    @TheTomtz

    Ай бұрын

    Just simply write on a glass board ,record it from the other side and laterally flip the image! Simple aa that.. and pls dont distract people from the contents being lectured by thinkin about the process behind the rec🤣

  • @thewallstreetjournal5675

    @thewallstreetjournal5675

    Ай бұрын

    Is the board fliped or has she been flipped?

  • @hamidapremani6151
    @hamidapremani61512 ай бұрын

    The explanation was spot on! IBM is the go to platform to learn about new technology with their high quality content explained and illustrated with so much simplicity.

  • @444Yielding
    @444Yielding27 күн бұрын

    This video is highly underviewed for as informative as it is!

  • @Shailendrashail
    @Shailendrashail8 ай бұрын

    Good Explanation of RAG. Thanks for sharing.

  • @jyhherng
    @jyhherng6 ай бұрын

    this let's me understand why the embeddings used to generate the vectorstore is a different set from the embeddings of the LLM... Thanks, Marina!

  • @paulaenchina
    @paulaenchina4 ай бұрын

    This is the best explanation I have seen so far for RAG! Amazing content!

  • @ReflectionOcean
    @ReflectionOcean5 ай бұрын

    1. Understanding the challenges with LLMs - 0:36 2. Introducing Retrieval-Augmented Generation (RAG) to solve LLM issues - 0:18 3. Using RAG to provide accurate, up-to-date information - 1:26 4. Demonstrating how RAG uses a content store to improve responses - 3:02 5. Explaining the three-part prompt in the RAG framework - 4:13 6. Addressing how RAG keeps LLMs current without retraining - 4:38 7. Highlighting the use of primary sources to prevent data hallucination - 5:02 8. Discussing the importance of improving both the retriever and the generative model - 6:01

  • @TheMsksk
    @TheMsksk8 ай бұрын

    Great video as always. Thanks for sharing.

  • @rujmah
    @rujmah2 ай бұрын

    Brilliant explanation and illustration. Thanks for your hard work putting this presentation together.

  • @vnaykmar7
    @vnaykmar75 ай бұрын

    Such an amazing explanation. Thank you ma'am!

  • @past_life_project
    @past_life_project3 ай бұрын

    I have watched many IBM videos and this is the undoubtedly the best ! I will be searching for your videos now Marina!

  • @rvssrkrishna2
    @rvssrkrishna22 ай бұрын

    Very precise and exact information on RAG in a nutshell. Thank you for saving my time.

  • @redwinsh258
    @redwinsh2586 ай бұрын

    The interesting part is not retrieval from the internet, but retrieval from long term memory, and with a stated objective that builds on such long term memory, and continually gives it "maintenance" so it's efficient and effective to answer. LLMs are awesome because even though there are many challenges ahead, they sort of give us a hint of what's possible, without them it would be hard to have the motivation to follow the road

  • @francischacko3627
    @francischacko362725 күн бұрын

    perfect explanation understood every bit , no lags kept it very interesting ,amazing job

  • @evaiintelligence
    @evaiintelligence29 күн бұрын

    Marina has done a great job explaining LLM and RAGs in simple terms.

  • @rafa1rafa
    @rafa1rafa5 ай бұрын

    Great explanation! The video was very didactic, congratulations!

  • @mstarlingc
    @mstarlingc5 ай бұрын

    Pretty simple explanation, thank you

  • @Anubis2828
    @Anubis28282 ай бұрын

    Great, simple, quick explanation

  • @toenytv7946
    @toenytv79462 ай бұрын

    Great down the rabbit hole video. Very deep and understandable. IBM academy worthy in my opinion.

  • @afshinkarimi2382
    @afshinkarimi23828 ай бұрын

    Great video. Thanks for sharing

  • @HimalayJoriwal
    @HimalayJoriwal2 ай бұрын

    Best explanation so far from all the content on internet.

  • @bdouglas
    @bdouglasАй бұрын

    That was excellent, simple, and elegant! Thank you!

  • @sawyerburnett8319
    @sawyerburnett83194 ай бұрын

    Wow, having a lightbulb moment finally after hearing this mentioned so often. Makes more sense now!

  • @Aryankingz
    @Aryankingz7 ай бұрын

    That's what Knowledge graphs are for, to keep LLMs grounded with a reliable source and up-to-date.

  • @khalidelgazzar
    @khalidelgazzar5 ай бұрын

    Great explanation. Thank you!😊

  • @kunalsoni7681
    @kunalsoni76816 ай бұрын

    Thanks for letting us know about this feature of LLM :)

  • @rockochamp
    @rockochamp5 ай бұрын

    very well executed presentation. i had to think twice about how you can write in reverse but then i RAGed my system 2 :)

  • @PaulGrew-wl7mh
    @PaulGrew-wl7mhАй бұрын

    An amazing explanation that made RAG understandable in about 4:23 minutes!

  • @rsu82
    @rsu824 күн бұрын

    good explanation, it's very easy to understand. this video is the first one when I search RAG on KZread. great job ;)

  • @user-im6ub3sf6m
    @user-im6ub3sf6m3 ай бұрын

    Great explanation with an example. Thank you

  • @user-hk5dk9rb6p
    @user-hk5dk9rb6p4 ай бұрын

    Fantastic video and explanation. Thank you!

  • @user-cd6hp5kc1n
    @user-cd6hp5kc1n7 ай бұрын

    The ability to write backwards, much less cursive writing backwards, is very impressive!

  • @IBMTechnology

    @IBMTechnology

    7 ай бұрын

    See ibm.biz/write-backwards

  • @jsonbourne8122

    @jsonbourne8122

    6 ай бұрын

    Left hand too!

  • @NishanSaliya

    @NishanSaliya

    5 ай бұрын

    @@IBMTechnology Thanks .... I was reading comments to check for an answer for that question!

  • @ashwinkumar675
    @ashwinkumar67524 күн бұрын

    This is so well explained! Thank you 👍🏻✅

  • @star2k279
    @star2k2794 ай бұрын

    Thank you for such a great explanation.

  • @preciousrose2715
    @preciousrose2715Ай бұрын

    This was such an amazing explanation!

  • @lauther_27
    @lauther_275 ай бұрын

    Amazing video, thanks IBM ❤

  • @oieieio741
    @oieieio7415 ай бұрын

    Very Helpful! Great explanation. thx IBM

  • @JasonVonHolmes
    @JasonVonHolmes2 ай бұрын

    This was explained fantastically.

  • @zuzukouzina-original
    @zuzukouzina-original3 ай бұрын

    Very clear explanation, much respect 🫡

  • @421sap
    @421sap6 ай бұрын

    Thank you, Marina Danilevsky ....

  • @Kekko400D
    @Kekko400D3 ай бұрын

    Fantastic explanation, proud to be an IBMer

  • @johnmccullough7084
    @johnmccullough70846 ай бұрын

    Appreciate the succinct explanation. 👍

  • @eddisonlewis8099
    @eddisonlewis80993 ай бұрын

    AWESOME EXPLANATION OF THE CONCEPT RAG

  • @aniket_mishr
    @aniket_mishrАй бұрын

    The explanation was very good 💯.

  • @alexiojunior7867
    @alexiojunior7867Ай бұрын

    wow this was an amazing Explanation ,very easy to understand

  • @laurentpastorelli1354
    @laurentpastorelli13544 ай бұрын

    Super good and clear, well done!

  • @gaemrpaterso-ri2jd
    @gaemrpaterso-ri2jd8 ай бұрын

    Great video, you guys should do one on promising tech industries

  • @deltawhiplash1614
    @deltawhiplash161413 күн бұрын

    This is a really good video thank you for sharing this knowledge

  • @thomasbrowne6649
    @thomasbrowne6649Ай бұрын

    This is excellent and I hope IBM does well in this space. We need a reliable, non-hype vendor.

  • @AdarshKumar-kx2cn
    @AdarshKumar-kx2cn3 ай бұрын

    Beautifully explained....thanks

  • @user-bo1kv5zy3w
    @user-bo1kv5zy3w7 ай бұрын

    Awesome explanation. Love you.

  • @siddharth4251
    @siddharth4251Ай бұрын

    Amazing explanation, finally i understand it.

  • @AntenorTeixeira
    @AntenorTeixeira5 ай бұрын

    That's the best video about RAG that I've watched

  • @ericmcnally5128
    @ericmcnally51282 ай бұрын

    This is a fantastic lesson video.

  • @user-xf4vm2gf6g
    @user-xf4vm2gf6g3 ай бұрын

    Excellent ! thank you for sharing this knowledge !

  • @sumedhaj9017
    @sumedhaj90172 ай бұрын

    Amazing explanation! Thank you:)

  • @rahulberry4806
    @rahulberry480621 күн бұрын

    thanks for the great explanation

  • @AC-xd7sw
    @AC-xd7sw4 ай бұрын

    Insightful, please more video like this

  • @sudhakarveeraraghavan5832
    @sudhakarveeraraghavan5832Ай бұрын

    Very well explained and it is easily understandable to non AI person as well. Thanks.

  • @stanislavzayarsky
    @stanislavzayarsky3 ай бұрын

    Finally, we got a clear explanation!

  • @zhanezar
    @zhanezarАй бұрын

    BRILLIANT VIDEO thank you!

  • @BooleanDisorder
    @BooleanDisorder5 ай бұрын

    Thank you for these videos. Makes it much easier to nagivate this new AI-ra of machine learning.

  • @shashankshekharsingh9336
    @shashankshekharsingh933617 күн бұрын

    very good and clear explanation

  • @terencelewis4985
    @terencelewis49853 ай бұрын

    Excellent explanation!

  • @Junglytics
    @Junglytics3 ай бұрын

    Great video, excellent explanation!

  • @MraM23
    @MraM233 ай бұрын

    Great lessons! Nice of you to step out 🙃 and make such engaging and educative content This is a very useful in helping us in critical thinking. Thank you for sharing this video. 👍 Current ai models may impose neurotypical norms and expectations based on current data trained on . 🤔 Curious to see more on how IBM approach the challenges and limitations of Ai

  • @user-uk9mt4ue6w
    @user-uk9mt4ue6w5 ай бұрын

    Все толково, четко и понятно. Респект автору.

  • @prasannakulkarni5664
    @prasannakulkarni5664Ай бұрын

    the color coding on your whiteboard is really apt here !

  • @paulc465
    @paulc4655 ай бұрын

    thank you. very informative!

  • @sprintwithcarlos
    @sprintwithcarlos6 ай бұрын

    Great explanation!

  • @mayankbumb7272
    @mayankbumb72727 күн бұрын

    Great explanation

  • @shinemuphy
    @shinemuphy5 ай бұрын

    Excellent explanation. thx

  • @ayanSaha13291
    @ayanSaha1329129 күн бұрын

    Great video! thanks for educating!

  • @aneesarom
    @aneesarom2 күн бұрын

    Best explanation ever

  • @kallamamran
    @kallamamran4 ай бұрын

    We also need the models to cross check their own answers with the sources of information before printing out the answer to the user. There is no self control today. Models just say things. "I don't know" is actually a perfectly fine answer sometimes!

  • @carvalhoribeiro
    @carvalhoribeiroАй бұрын

    Amazing work. Thanks for sharing this.

  • @neutron417
    @neutron4174 ай бұрын

    From which corpus/database are the documents retrieved from? Are they up-to date? and how does it know the best documents to select from a given set?

  • @mohamadhijazi3895
    @mohamadhijazi3895Ай бұрын

    The video is short and consice yet the delivery is very elegant. She might be the best instructor that have teached me. Any idea how the video was created?

  • @randomforest_dev
    @randomforest_dev29 күн бұрын

    Very good explanation!

  • @katsunoi
    @katsunoi5 ай бұрын

    nice video - great explanation!

  • @sk-6032
    @sk-60329 күн бұрын

    Very well explained 🙏🏼👍

  • @yashkhorania3726
    @yashkhorania372616 күн бұрын

    very nicely explained

  • @sharingmatters
    @sharingmatters2 ай бұрын

    Well explained!