BERT Neural Network - EXPLAINED!

Understand the BERT Transformer in and out.
Follow me on M E D I U M: towardsdatascience.com/likeli...
Please subscribe to keep me alive: kzread.info...
PLAYLISTS FROM MY CHANNEL
⭕ Reinforcement Learning: • Reinforcement Learning...
Natural Language Processing: • Natural Language Proce...
⭕ Transformers from Scratch: • Natural Language Proce...
⭕ ChatGPT Playlist: • ChatGPT
⭕ Convolutional Neural Networks: • Convolution Neural Net...
⭕ The Math You Should Know : • The Math You Should Know
⭕ Probability Theory for Machine Learning: • Probability Theory for...
⭕ Coding Machine Learning: • Code Machine Learning
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStati...
📕 Bayesian Statistics: imp.i384100.net/BayesianStati...
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow
REFERENCES
[1] BERT main paper: arxiv.org/pdf/1810.04805.pdf
[1] BERT in google search: blog.google/products/search/s...
[2] Overview of BERT: arxiv.org/pdf/2002.12327v1.pdf
[4] BERT word embeddings explained: / why-bert-has-3-embeddi...
[5] More details of BERT in this amazing blog: towardsdatascience.com/bert-e...
[6] Stanford lecture slides on BERT: nlp.stanford.edu/seminar/deta...

Пікірлер: 328

  • @CodeEmporium
    @CodeEmporium Жыл бұрын

    For details and code on building a translator using a transformer neural network, check out my playlist "Transformers from scratch": kzread.info/dash/bejne/g3d-s6ltdNiuhJM.html

  • @AmandeepSingh-xk4yv
    @AmandeepSingh-xk4yv4 жыл бұрын

    Just watched a video on Transformers, and now this. Am astounded at how you explained such complex notions with such ease! Hugely underrated channel!

  • @CodeEmporium

    @CodeEmporium

    4 жыл бұрын

    Thanks a lot! Glad you liked it 😊

  • @brilliantdirectoriestraining
    @brilliantdirectoriestraining3 жыл бұрын

    I have studied for several years AI, NPL and Neural networks. But the way you explained this was lovely, friendly and very simple which is why I am pretty sure you are BERT

  • @jeenakk7827
    @jeenakk78273 жыл бұрын

    I wish I had come across this channel earlier. You have a wonderful skill in explaining complicated concepts. I love your "3 pass" approach!!

  • @andrewlai3358
    @andrewlai33584 жыл бұрын

    Thank you for the explanation. You really have a knack for explaining NLP concepts clearly without losing much fidelity. Please keep posting!

  • @mauriciolandos4712
    @mauriciolandos4712 Жыл бұрын

    Best explanator on youtube, you have a good mix of simplifying so it can be understood, but not overly simplifying so we learn deeply enough. The idea of having 3 passes going deeper was a great idea as well.

  • @ankit_khanna
    @ankit_khanna3 жыл бұрын

    One of the best videos on BERT. Great work! Wishing you loads of success!

  • @dannysimon2965
    @dannysimon29654 жыл бұрын

    Wow, thanks!! I tried watching many videos and couldn't understand a single thing. But yours was truly concise and informative.

  • @maverick3069
    @maverick30693 жыл бұрын

    The multiple passes of explanation is an absolutely brilliant way to explain! Thanks man.

  • @rashmikuchhal5339
    @rashmikuchhal53393 жыл бұрын

    I always watch your videos and appreciate the efforts you put to make the complicated topics so easy and clear. Thankyou for all your work. I really like the way you explain in 3 passes.... great work

  • @madhubagroy
    @madhubagroy2 жыл бұрын

    The BEST explanation on BERT. Simply outstanding!

  • @abhikc8108
    @abhikc81083 жыл бұрын

    Great explanation, I really like the three pass idea it breaks down a lot of complications to simple concepts.

  • @BogdanSalyp
    @BogdanSalyp3 жыл бұрын

    Extremely underrated channel, didn't find any other good explanation on KZread/Medium/Google

  • @MarketingLeap
    @MarketingLeap3 жыл бұрын

    Loved how you explained BERT really well. Great job!

  • @user-qx3jn9ii7s
    @user-qx3jn9ii7s3 жыл бұрын

    Hey, your explantation and presentation on complicated concepts made me clear about TF and BERT. I will expect you to upload more exciting videos.

  • @AbdulWahab-cy9ib
    @AbdulWahab-cy9ib3 жыл бұрын

    Was struggling to understand the basics of BERT after going through Transformer model. This video was indeed helpful.

  • @ziangtian
    @ziangtian Жыл бұрын

    OMG!!!! This vid is a life-saver! just elucidated so many aspects of NLP to me (a 3 month beginner who still understands nothing

  • @amreshgiri
    @amreshgiri3 жыл бұрын

    Probably the best (easiest to understand in one go) video on BERT. Thanks ❤️

  • @NadavBenedek
    @NadavBenedek2 жыл бұрын

    I love the "pass1" "pass2" concept of how you explain things. It's great.

  • @healthertsy1863
    @healthertsy18638 ай бұрын

    Don't hesitate, this is the best video of BERT explanation for sure!

  • @aruncjohn
    @aruncjohn3 жыл бұрын

    Excellent explanation!. Will never miss a video of yours from now on!

  • @Kumar08
    @Kumar083 жыл бұрын

    Fantastic explanation, Covered each and every point in the BERT. Looking forward for more videos on NLP.

  • @usamahussain4461
    @usamahussain44612 жыл бұрын

    Phenomenal the way you condense such a complicated concept into a few minutes, clearly explained.

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Thanks so much for the compliments:)

  • @rajeshve7211
    @rajeshve72112 күн бұрын

    Best ever explanation of BERT! Finally understood how it works :)

  • @bidyapatip
    @bidyapatip3 жыл бұрын

    After reading lot of blogs, videos, I understood its so difficult network. But after going through this, I feel so easy to understand BERT(and its varient available in transformer library)

  • @prasannabiswas2727
    @prasannabiswas27273 жыл бұрын

    I read many blogs on BERT but they were more focused on how to use BERT rather than what actually BERT is?. This video helped me clear all my doubts regarding how Bert is trained. Clear and concise explanation.

  • @krishnaik06
    @krishnaik063 жыл бұрын

    Amazing Explanation :)

  • @doyourealise

    @doyourealise

    3 жыл бұрын

    big fan sir

  • @richarda1630

    @richarda1630

    3 жыл бұрын

    hear hear! so agree!

  • @User-nq9ee

    @User-nq9ee

    2 жыл бұрын

    To teach us , you study and explore .. really grateful for your efforts Krish .

  • @indgaming5452

    @indgaming5452

    Жыл бұрын

    Where there is krish sir... I will come there. .... Sir I found u here also... We are learning together 😇

  • @itsme1674

    @itsme1674

    Жыл бұрын

    Nice to meet you sir

  • @pallavijog912
    @pallavijog9123 жыл бұрын

    Wow.. just switched from another BERT explained video to this.. stark difference.. excellent explanation indeed.. thanks..

  • @noumaaaan
    @noumaaaan3 жыл бұрын

    This explanation is pretty amazing! I have a presentation on this soon. Thank you so much!

  • @NachoProblems
    @NachoProblems7 ай бұрын

    Do you realize you are the only good description of how exactly fine tuning works I have found, and I've been researching for months. Thank you!!!

  • @CodeEmporium

    @CodeEmporium

    7 ай бұрын

    You are too kind. Thank you for the donation. You didn’t have to bug it is appreciated. Also super glad this content was useful! More of this to come

  • @aeirya1686
    @aeirya16866 ай бұрын

    Very very friendly, clear and masterful explanation. This is exactly what I was after. Thank you!

  • @rohanmirchandani9726
    @rohanmirchandani97263 жыл бұрын

    This is one of the best resources explaining BERT available online.

  • @michaelherrera4450
    @michaelherrera44503 жыл бұрын

    Dude this video is incredible. I cannot express how good you are at explaining

  • @CodeEmporium

    @CodeEmporium

    3 жыл бұрын

    Thanks for watching! Super glad it is useful

  • @path1024

    @path1024

    Жыл бұрын

    Good try though!

  • @ruyanshou805
    @ruyanshou8053 жыл бұрын

    Well explained! I have been looking for something like this for quite long!

  • @josephselwan1652
    @josephselwan16522 жыл бұрын

    Amazing stuff. For visualization purposes, when you get into a deeper pass, I would recommend always adding the zooming effect for intuitive understanding. I am not sure about others, but when you do that, I instantly know "OK, now we are within this 'box' "

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    Good thought. I'll try to make this apparent in the future. Thanks!

  • @sajaal-dabet148
    @sajaal-dabet1483 жыл бұрын

    This is amazing! Crystal clear explanation, thanks a lot.

  • @pathuri86
    @pathuri86 Жыл бұрын

    Excellent and concise explanation. Loved it. Thanks for this fantastic video.

  • @Deddiward
    @Deddiward3 жыл бұрын

    Wow I've just discovered your channel, it's full of resources, very nice!

  • @mohamedsaaou9258
    @mohamedsaaou92584 жыл бұрын

    Wonderful, and the best explanation of BERT ever :) , Good Job , and big thank you !

  • @felixakwerh5189
    @felixakwerh51893 жыл бұрын

    great video, i like the 3-pass method you used to explain the concepts

  • @arvindvasudevan45
    @arvindvasudevan453 жыл бұрын

    Excellent articulation of the concept. Thank you.

  • @LoLelfy
    @LoLelfy3 жыл бұрын

    Omg your videos are so good! So happy I found your channel, I'm binge watching everything :D

  • @CodeEmporium

    @CodeEmporium

    3 жыл бұрын

    Glad you found my channel too! Thank you! Hope you enjoy them!

  • @jx7433
    @jx74332 ай бұрын

    Excellent Explanation! Thank you!

  • @xJFGames
    @xJFGames Жыл бұрын

    I'm honestly amazed of how you managed to transform a complex algorithm in a simple 10 minutes video. Much thanks to you, my final thesis appreciates you.

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Hahaha anytime ):

  • @magelauditore333
    @magelauditore3333 жыл бұрын

    Such a underrated channel. Keep it up man

  • @gauravsahani2499
    @gauravsahani24993 жыл бұрын

    Loved the explanation, Sir!

  • @arturjaroszewicz8424
    @arturjaroszewicz84242 ай бұрын

    Beautiful explanation!

  • @ydas9125
    @ydas9125 Жыл бұрын

    I am very impressed by the clarity and core focus of your explanations to describe such complex processes. Thank you.

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    You are very welcome. Thanks for watching and commenting :)

  • @agustindiaz3361
    @agustindiaz33614 жыл бұрын

    Your videos are great! Amazing work

  • @andymoses95
    @andymoses954 жыл бұрын

    The one which I was looking for the past 6 months.! Thanks a lot for making this.

  • @CodeEmporium

    @CodeEmporium

    4 жыл бұрын

    I'm late. But. Here now!

  • @20.nguyenvongockhue80
    @20.nguyenvongockhue802 ай бұрын

    wow AMAZING EXPLAINATION. Thank you very much

  • @akashsaha3921
    @akashsaha39213 жыл бұрын

    Well explained. Short and to the point

  • @ilyasaroui7745
    @ilyasaroui77454 жыл бұрын

    Good touch to put the references on the description instead of on the slides

  • @somerset006
    @somerset0069 ай бұрын

    Nice job, man! Especially the multi-phase approach of explaining things, top to bottom.

  • @CodeEmporium

    @CodeEmporium

    9 ай бұрын

    Super happy you liked the approach. Thanks for commenting

  • @nooshnabi9248
    @nooshnabi92482 жыл бұрын

    Great Video! So easy to follow!

  • @erfanshayegani3693
    @erfanshayegani3693 Жыл бұрын

    Every time I watch this video I gain a better understanding of the procedure. Thanks a lot for the great content!!!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Anytime! Look forward for more

  • @snowglade1
    @snowglade13 жыл бұрын

    Hey this is an exceptional training video.

  • @aitrends8901
    @aitrends89012 жыл бұрын

    Very nice high level understanding of Transformers...

  • @TheMehrdadIE
    @TheMehrdadIE3 жыл бұрын

    Awesome! How simple you explain these models :)

  • @themaninjork
    @themaninjork3 жыл бұрын

    Your Videos are very well explained !

  • @pratyushnegi4082
    @pratyushnegi40822 жыл бұрын

    Thanks for explaining this in such a simple way :)

  • @urd4651
    @urd46512 жыл бұрын

    thank you for sharing the video! very clear and helpful!!

  • @naveen6630
    @naveen66303 жыл бұрын

    Hey. Your playlists are great. Also, the BERT explanation was excellent by the way. I am having a thought of working with farm-haystack using flask, dockers, and BERT. So I wonder whether if it's kind of the same you have explained, if not could you share your knowledge on that with me. Thank you.

  • @keyrellousadib6124
    @keyrellousadib6124 Жыл бұрын

    This is an excellent summary. Very clear and super well organized. Thanks very much

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Thank you so much for watching ! And for the wonderful comment :$

  • @She_cooks2023
    @She_cooks20234 ай бұрын

    Amazing explanation !!

  • @deepeshkumar4945
    @deepeshkumar4945 Жыл бұрын

    dude , you are amazing , you explained the state of the art NLP model , in such a well explained and concise video . Thanks a ton for this video !!!!!!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    You are super welcome. Thanks so much for commenting this!

  • @prathyusha5393
    @prathyusha53933 жыл бұрын

    Thanks a bunch for these wonderful videos!

  • @seeunkim4185
    @seeunkim4185 Жыл бұрын

    Thank you so much for the clear explanation, I get the grip of the BERT now!

  • @mays7n
    @mays7n10 ай бұрын

    this must be one of the best explanation videos on the internet, thank you!

  • @CodeEmporium

    @CodeEmporium

    10 ай бұрын

    You are very welcome :)

  • @rizwanulhoqueratul4811
    @rizwanulhoqueratul48113 жыл бұрын

    Thank you for the reference links!

  • @mohsennayebi86
    @mohsennayebi862 жыл бұрын

    Amazing Explanation! I am speechless :)

  • @TSP-NPC
    @TSP-NPC11 ай бұрын

    Thanks for the great explanation of Transformers and the architecture of BERT.

  • @CodeEmporium

    @CodeEmporium

    11 ай бұрын

    My pleasure and thank you for the super thanks :)

  • @gauravchatterjee794
    @gauravchatterjee7943 жыл бұрын

    Best Explanation by far!

  • @JP-gk6pi
    @JP-gk6pi3 жыл бұрын

    3 pass explanation is a really good approach to explain this complex concept. Best video on BERT

  • @beteaberra631

    @beteaberra631

    2 жыл бұрын

    Great video! But what is pass 1, pass 2 and pass 3?

  • @BiranchiNarayanNayak
    @BiranchiNarayanNayak4 жыл бұрын

    Best explanation i have seen so far on BERT.

  • @CodeEmporium

    @CodeEmporium

    4 жыл бұрын

    I thank you kindly ;)

  • @nehccc
    @nehccc7 ай бұрын

    very good explanation! thank you!

  • @jeflee2787
    @jeflee27873 жыл бұрын

    Thanks man! Great work!

  • @yunlongsong7618
    @yunlongsong7618 Жыл бұрын

    Excellent explanation

  • @namanbhayani1016
    @namanbhayani10163 жыл бұрын

    Very well explained!

  • @goelnikhils
    @goelnikhils Жыл бұрын

    Excellent Explanation. Main thing to note is the finer point around explanation/mention of the loss functions that BERT uses. As not many other videos on same topic cover this. Tood Good

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Thanks so much :)

  • @dhananjaysonawane1996
    @dhananjaysonawane19963 жыл бұрын

    @11:08 Please go on forever :):D... the best explanation I have seen so far, Thanks man!

  • @harshavardhany2970
    @harshavardhany29703 жыл бұрын

    Simple and clear explanations (which shows you know what you're talking about). And cool graphics. Will be back for more videos :)

  • @CodeEmporium

    @CodeEmporium

    3 жыл бұрын

    Thanks! Keep tuning in!

  • @maryamaziz3841
    @maryamaziz38413 жыл бұрын

    Thanks for wonderful explanation for bert architecture 🍀🌹

  • @findingx152
    @findingx15210 ай бұрын

    great explanation.. Thanks !!

  • @medomed1105
    @medomed11053 жыл бұрын

    Amazing Explanation

  • @rodrigomaldonado5280
    @rodrigomaldonado52803 жыл бұрын

    new subscriber, amazing explanation!

  • @alassanndiallo
    @alassanndiallo3 жыл бұрын

    Excellent job

  • @caoshixing7954
    @caoshixing79544 жыл бұрын

    Very good explanation, Easy to understand! Come on!

  • @renosyaputra
    @renosyaputra3 жыл бұрын

    Thank you, clear and direct explanation

  • @adityaj9984
    @adityaj99848 ай бұрын

    BEST EXPLAINATION EVEERRRR

  • @srinivasanthiruvengadathan2177
    @srinivasanthiruvengadathan21774 жыл бұрын

    Excellent Explanation. Thanks

  • @jan-rw2qx
    @jan-rw2qx Жыл бұрын

    First half is exactly how much I need to understand right now, thank you :)

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Awesome! You are very welcome!

  • @TechVizTheDataScienceGuy
    @TechVizTheDataScienceGuy3 жыл бұрын

    Nicely done

  • @dharmendrathakur1487
    @dharmendrathakur14873 жыл бұрын

    Big Big Thanks to make such awesome Videos..

  • @venupunna9940
    @venupunna99403 жыл бұрын

    Thank you for the wonderful content...

  • @sathyakumarn7619
    @sathyakumarn76193 жыл бұрын

    Not bad! Loved the video. Please add a little bit of more explanation for upcoming vids if preferrable.

  • @rahuldey6369
    @rahuldey63692 жыл бұрын

    I've read 4 articles before coming here. Couldn't connect the dots. This single video showed me the way.. Thanks a lottt

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    Super glad it helped :)

  • @dipanjanghosal6164
    @dipanjanghosal61644 жыл бұрын

    Thanks for such a nice overview .. Very well done animation which augments the understanding further.. Maybe you could have touched on Roberta here and the differences. May be a separate video for that?

  • @CodeEmporium

    @CodeEmporium

    4 жыл бұрын

    Thanks! Roberta is on my list. Wasn't kidding when I said there is a lot on Bert. Will make that in another video

  • @beingnothing34
    @beingnothing343 жыл бұрын

    Amazing. Thanks a lot. You really **demystify** !!

  • @alidi5616
    @alidi56162 жыл бұрын

    That's it. The best explanation i came through. Receive my upvote and subscription 😁

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    Many thanks. Join the discord too :3