A friendly introduction to Bayes Theorem and Hidden Markov Models

Ғылым және технология

Announcement: New Book by Luis Serrano! Grokking Machine Learning. bit.ly/grokkingML
40% discount code: serranoyt
A friendly introduction to Bayes Theorem and Hidden Markov Models, with simple examples. No background knowledge needed, except basic probability.
Accompanying notebook:
github.com/luisguiserrano/hmm

Пікірлер: 690

  • @pauldacus4590
    @pauldacus45905 жыл бұрын

    Happy I found this video.. even though it was rainy outside

  • @kebman

    @kebman

    4 жыл бұрын

    Happy I found this video.. even though there's a Corona lockdown :D

  • @pqppd8491

    @pqppd8491

    3 жыл бұрын

    It's coincidentally rainy outside 😂

  • @a7md944

    @a7md944

    3 жыл бұрын

    Based on previous experiance, because it is rainy at your side, i predict that you were probably not happy 😔

  • @TymexComputing

    @TymexComputing

    15 күн бұрын

    @@a7md944 Bob was more likely not happy, we are the hidden state - whats the probability that the lockdown was not justified and that people were dying because of lack of medical help instead of the illness.

  • @csejpnce2585
    @csejpnce25856 жыл бұрын

    Usually Bayes Theorem and HMM are nightmare to even researchers. In this video these nightmares are made like child's play. I'm highly thankful for this service you are providing to the academic community- teachers, researchers and students. Keep it up Luis Serrano and hope to see many more plays in future!!!

  • @somdubey5436
    @somdubey54363 жыл бұрын

    your are one of those rarest breed of gifted teachers

  • @Slush_
    @Slush_4 жыл бұрын

    You have just saved me, this was such a clear breakdown of Bayes Theorem and HMMs, and exactly what I needed at the 11th hour of a project I'm working on!

  • @noduslabs
    @noduslabs4 жыл бұрын

    Beautiful work! It’s the most accessible introduction to Bayes inference I’ve seen. Great job! Please, keep them coming!

  • @BabakKeyvani0
    @BabakKeyvani05 жыл бұрын

    Thank you so much for this great video Luis. I am a Udacity alumni myself. I have watched & read many videos and articles on Bayes & HMMs, but your video by far is the best. It explains all the steps in the right amount of detail & does not skip any steps or switch examples. The video really helped solidify the concept, and giving the applications of these methods at the end really helps put them in context. Thank you again very much for your information & helpful video.

  • @fanfanish
    @fanfanish5 жыл бұрын

    I can't believe how you did it so clear and simple. gorgeous

  • @shuchitasachdev9310
    @shuchitasachdev93105 жыл бұрын

    This is the best description of this topic I have ever seen. Crystal clear! True knowledge is when you can explain a complex topic as simple as this!

  • @ipaliipali8804
    @ipaliipali88045 жыл бұрын

    Being a teacher myself for long time all I can say is that this video is awesome! You have a talent my friend.

  • @simpleprogramming4671
    @simpleprogramming46716 жыл бұрын

    wow. perfect explanation . Even a kid can learn HMM by watching this video

  • @theavo
    @theavo4 жыл бұрын

    I'm on a streak of watching your third video in a row and instantly liking it for outstandingly easy-to-understand breakdown of a quite complex topic. Well done, sir, I'll visit your channel in the future for sure! ✨

  • @codebinding71
    @codebinding716 жыл бұрын

    Your video tutorials are a great breakdown of very complex information into very understandable material. Thank You. It would be great if you could make a detailed video on PCA, SVD, Eginvectors, Random Forest, CV.

  • @jacobmoore8734

    @jacobmoore8734

    5 жыл бұрын

    Eigenvectors and SVD for sure.

  • @ericbauer6595

    @ericbauer6595

    4 жыл бұрын

    @@jacobmoore8734 check out 3blue1brown's channel for the Essence of Linear Algebra. He explains that matrices are linear functions like y=f(x) or like a line 'y=mx', with y-intercept b=0. Eigenvectors are special inputs 'x' such that f(x) = kx, where k is some scalar coefficient (k is the eigenvalue associated with the special input x). For certain types of NxN matrices, (the covariance matrix used in PCA for example) are super interesting because any point in N-dimensional coordinates can be represented as a linear combination (ax1 + bx2+...) of the eigenvectors. The eigenvectors form a 'basis' for that space. This is where SVD (singular value decomposition) comes in. SVD essentially asks "instead of just multiplying x by your matrix, why don't you decompose this task into 3 easier tasks?" Let's say your matrix is C for covariance. Then SVD says that C = ULU' where U is made up of the eigenvectors for columns, U' is the transpose of U, and L is a diagonal matrix with the eigenvalues. Pretend we're doing y = C*x. Then first we do w = U'*x. This essentially represents x as a linear combination of eigenvectors. Said another way, you've changed the representation of point x from the original coordinate system to the eigenvector coordinate system. Next we do z = L*w, which scales every value of vector w by an eigenvalue. Some of these eigenvalues are very small and the result in z is perhaps closer to 0. Some of these eigenvalues are relatively large and upscale the result in z. Finally, when you do y = U*z, all you're doing it translating your scaled z vector back into the original coordinate system. So SVD basically splits a matrix into 3 different operations: 1. represents an input vector in terms of eigenvector coordinates 2. scales each coordinate by an eigenvalue 3. represents the scaled result back in terms of the original coordinates When you look at PCA (principal components analysis), you take your covariance matrix and decompose it to look at how much your eigenvalues scale the eigenvector coordinates. The largest eigenvalues correspond to the direction (eigenvector) of largest variation

  • @noduslabs

    @noduslabs

    4 жыл бұрын

    Definitely eigenvectors! Please!

  • @kapil_vishwakarma

    @kapil_vishwakarma

    4 жыл бұрын

    Yes, please, do that.

  • @SaptarsiGoswami

    @SaptarsiGoswami

    4 жыл бұрын

    You may have already found some, this is an attempt by University of Calcutta, not so coolly done, but please see if it makes sense kzread.info/dash/bejne/dWqaqpeHltLQZJM.html

  • @cybren2
    @cybren24 жыл бұрын

    Thank you so much for this video! I searched for hours, watched many videos, read many websites/ papers etc. but i never really understood what a HMM and the algorithms are and how they work. You explained everything from how it works to how to implement it so well that I got in 30 minutes, what i didnt get in hours before. Thank you so much!!

  • @geovalexis
    @geovalexis4 жыл бұрын

    Simply amazing! After quite a long time struggeling to understand HHM now I finally get it. Thank you so much!!

  • @at4652
    @at46525 жыл бұрын

    Top notch and best explanations. You are taking complex subjects and making it intuitive not an easy thing to do !

  • @CBausGB
    @CBausGB3 жыл бұрын

    It's impressing how simple you explain very complex issues! Thank you!!

  • @sintwelve
    @sintwelve5 жыл бұрын

    Thank you so much for this. I wish more educators were more like you.

  • @chenqu773
    @chenqu7733 жыл бұрын

    The most exciting thing I found in your video is that most of them is a one-stop solution for dummies like me, without the need to go to other 100 places to find 50 missing info pieces. Many thanks !

  • @changyulin47
    @changyulin475 жыл бұрын

    OMG! you are amazing! I consider myself as a information theory guy and should know this pretty well. But I can never present this idea as simple and easy understanding as you did! Great great job! I will for sure check around your other videos! Thank you!

  • @SerranoAcademy

    @SerranoAcademy

    5 жыл бұрын

    Thank you Changyu!

  • @danielking7988
    @danielking79886 жыл бұрын

    Your videos are amazing! As someone who hasn't looked at calculus in 20 years, I find these "friendly introduction" videos extremely helpful in understanding high-level machine learning concepts, thank you! These videos really make me feel like this is something I can learn.

  • @generationgap416

    @generationgap416

    Жыл бұрын

    Isn't this opposite of calculus? Discrete vs continuous functions.

  • @urcisproduction797
    @urcisproduction7975 жыл бұрын

    You are the best explainer I have found in youtube till now! Great work!

  • @avwillis
    @avwillis5 жыл бұрын

    a beautiful combination of all the difficult concepts in probability in one video. great job.

  • @johnpetermwangimukuha
    @johnpetermwangimukuha11 ай бұрын

    Man Bayesian Theory has been having me for Breakfast! Thank you for this tutorial!

  • @ramakalagara3577
    @ramakalagara35773 жыл бұрын

    You made it so ease for learners... Appreciate the time you are spending in creating the content!!

  • @mahdiebrahimi1241
    @mahdiebrahimi12414 жыл бұрын

    best description about HMM, I had hard time to understand this topic, but your teaching keep me motivated for further learning.

  • @kassymakhmetbek5848
    @kassymakhmetbek58484 жыл бұрын

    I wish professors would just show this video in lectures... You are great at making these animations and your speech is perfect. Thank you!

  • @namnguyen7153
    @namnguyen71534 жыл бұрын

    Thank you so much! This video literally helps me understand 3 lectures in my machine learning class

  • @StarEclipse506
    @StarEclipse5065 жыл бұрын

    I took a probability class and did badly. After recently finding out I'd need to revisit it for machine learning, I was a bit concerned. Then I come to understand an algorithm for Baye's Theorem!! How incredible, thank you!!

  • @eTaupe
    @eTaupe4 жыл бұрын

    Thanks to your videos, I save a huge amount of time. Focusing on the intuition and mechanic allows an instant understanding BEFORE delving into the maths

  • @dennishuang3498
    @dennishuang34985 жыл бұрын

    So great by using sample example to explain confusing yet very important topics! Appreciate your excellent tutorial!

  • @soliloquy2006
    @soliloquy20064 жыл бұрын

    Thanks so much for this! It really helped with a research report I'm writing. Clear and easy to understand and the pacing was excellent for being able to take notes.

  • @vladimir_egay
    @vladimir_egay4 жыл бұрын

    Nice job! Best explanation by now. Explained 6 weeks of my class in 32 minuts!

  • @dYanamatic
    @dYanamatic4 жыл бұрын

    Amazing ... I just bought your book from Australia. Thank you for your time and effort!!!

  • @tintr.9619
    @tintr.96196 жыл бұрын

    Really hope to see more and more "friendly" videos from you ! Thanks a lot !

  • @meshackamimo1945
    @meshackamimo19455 жыл бұрын

    And please do a video on the baum-welch algorithms. Once again, no words to thank you! Happy New year!

  • @sonasondarasaesaria1941
    @sonasondarasaesaria19412 жыл бұрын

    Hi Luis Serrano thanks for the clear explanations, your informal way to explain this material is the best for us as a student, even my professor in Machine Learning class recommend this video for learning the HMM introduction!

  • @iglf
    @iglf4 жыл бұрын

    I was going thru HMMs for robot localization and found this super clear explanation. Eres un fenomeno, Luis. Gracias!

  • @me-zb7qm
    @me-zb7qm6 жыл бұрын

    I have a midterm in 8 hours and this video is the only thing that's really helped me so far. Cleared up all my confusions during 8 lectures in 32 minutes. Thank you so much, from the bottom of my heart.

  • @SerranoAcademy

    @SerranoAcademy

    6 жыл бұрын

    Thank you for your note, I hope the midterm went great! :)

  • @viro-jx2ft
    @viro-jx2ftАй бұрын

    This is the best ever video you will find on HMM. Complicated concepts handled soooo wellll🥰

  • @LizaBrings
    @LizaBrings5 жыл бұрын

    Omg. You just replaced an entire dry, non-understandable book for bioinformatics! I can’t thank you enough! It’s so easy!

  • @aatmjeetsingh7555
    @aatmjeetsingh75554 жыл бұрын

    this example made everything crystal clear, I have an exam tomorrow on HMM. Initially, I was anxious but after this video I'm sure I can solve any problem. Thank you very much, sir.

  • @jfister2481
    @jfister24815 жыл бұрын

    Best explanation of Hidden Markov Models on the Internet. Well done.

  • @vishwajitiyer4716
    @vishwajitiyer47164 жыл бұрын

    A very nicely done and visually appealing video on a slightly complex topic. Thank you!

  • @JW-nc4fi
    @JW-nc4fi4 жыл бұрын

    Thank you for making this! Fantastic and easy-to-understand explanation of the topic.

  • @pratiksharma1655
    @pratiksharma16555 жыл бұрын

    I wasted the whole day understanding HMM model by watching useless youtube videos, untill I saw this. Thank you so much for this video. It is so simple and so intuitive. So very thankful to you :)

  • @shapeletter
    @shapeletter3 жыл бұрын

    It was so nice with images! When you switched to letters, it was super clear how much easier it was to look at images!

  • @fuadmohammedabubakar9202
    @fuadmohammedabubakar92022 жыл бұрын

    Really amazing video that breaks down Bayes Theorem for simple understanding. Thanks Luis

  • @mrinmoykshattry527
    @mrinmoykshattry5273 жыл бұрын

    This is the best video that explains HMM so simply to someone who doesn't have a computer science background. Godspeed to you

  • @AB-km5sp
    @AB-km5sp5 жыл бұрын

    The best explanation of HMM ever! Very visual and easy to grasp. Enjoyed learning so much. Thanks! Edit: Can you please do a friendly video on EM algorithm, too?

  • @anderswigren8277
    @anderswigren82776 жыл бұрын

    This is the best explanation of HMM i ever seen up to now!

  • @SupremeSkeptic
    @SupremeSkeptic5 жыл бұрын

    Very comprehensive and easily understandable. Even though I get increasingly impatient to watch the whole thing, I still managed to swing the thumb up.

  • @arbaazaattar6266
    @arbaazaattar62666 жыл бұрын

    Made my day...I learned Hidden Morkov Model for first ever time n guess wht? It was damn simple to understand the way explained.

  • @muhammadyousuf2828
    @muhammadyousuf28284 жыл бұрын

    I am a bio-organic chemist and we have a bioinformatics course which included Hidden Markov Model and your video helped me to learn the idea without immersing myself deep into mathematics. Thanks ...

  • @ImperialArmour
    @ImperialArmour3 жыл бұрын

    Thanks Luis, I was taught HMMC using speech recognition, but will be having case study test on robot vacuums using this. I really appreciate it.

  • @arisweedler4703
    @arisweedler47033 жыл бұрын

    Thanks for the straightforward explanation of Bayesian networks + Hidden Markov Models. Cool stuff! Very powerful.

  • @PALPABLEemotions
    @PALPABLEemotions4 жыл бұрын

    Excellent video, i remember looking at this on wikipedia and just not having a clue of what it meant, you did a fantastic job of explaining it!

  • @smmehrab
    @smmehrab3 жыл бұрын

    Thank you so much! Your explanation and the way you presented the concept, was so crystal clear. Loved learning it.

  • @vaibhavjadhav3453
    @vaibhavjadhav34533 жыл бұрын

    Thank you so much for this beautiful explanation. learned about application of Bayes and Markov together ...Would happy to see more engineering application of these thermos..

  • @PinaTravels
    @PinaTravels3 жыл бұрын

    This has taken me from 0 to 80% on HMM. Thanks for sharing

  • @nigerinja7195
    @nigerinja71953 жыл бұрын

    Thanks alot! I came across your video while searching for HMM-explanation for my computational biology course, and it helped a lot to understand the basic principle :)

  • @leonidassilvajr.4278
    @leonidassilvajr.42783 жыл бұрын

    Your videos are a real thing! Thank you very much for those explanations. That would be great if you could bring some videos on PCA, SVD, SVM and GMM.

  • @AnshumanDVD
    @AnshumanDVD4 жыл бұрын

    I am a first time viewer but with such kind of amazing explanations, I will always stick to your teaching, vow so nicely explained!

  • @jokmenen_
    @jokmenen_3 жыл бұрын

    Very good video! Simple examples make it very approachable and keeps it from being overwhelming

  • @RC-bm9mf
    @RC-bm9mf3 жыл бұрын

    Dr Serrano, I think you are an embodiment of Feynman in ML education! Thanks a lot!!

  • @eaae
    @eaae3 жыл бұрын

    In this video I explain what conditional probabilities are and I show how to calculate them in Excel and how to interpret them, using Solver to implicitly apply Bayes' theorem. Though in spanish, subtitles in english are available: kzread.info/dash/bejne/pKx8xpmtlJm-n5M.html.

  • @chrisogonas
    @chrisogonas3 жыл бұрын

    Well illustrated. Thanks for putting this together.

  • @yogeshmadhavareddy8265
    @yogeshmadhavareddy82654 жыл бұрын

    Well, great video, the most fascinating thing is that you actually reacted to so many comments. That is so nice :)

  • @user-or7ji5hv8y
    @user-or7ji5hv8y5 жыл бұрын

    I really like your example. It really helps with the understanding.

  • @andreassabin117
    @andreassabin1176 жыл бұрын

    Excellent introduction into this topic. Thanks for your work.

  • @stephenhobbs948
    @stephenhobbs9484 жыл бұрын

    Very easy to understand using Bob and Alice and the weather. Thanks.

  • @deveshmore3106
    @deveshmore31063 жыл бұрын

    As a feedback I would say your explanation is spot on .... A person with basic statistical knowledge can understand HMM with your explanation

  • @sciencoking
    @sciencoking5 жыл бұрын

    Great job, I got it immediately. Very good illustrations too, simple and to the point

  • @sorrabedseraos6413
    @sorrabedseraos64136 жыл бұрын

    This video helped me a lot to understand these concepts and applications. Good job!

  • @singhrameshk
    @singhrameshk5 жыл бұрын

    Super interesting explanation. I wish I had studied things like this when I was in school.

  • @theapplecrumble
    @theapplecrumble5 жыл бұрын

    Very helpful and clear example and explanation. Thank you!

  • @elaf.m.8925
    @elaf.m.89254 жыл бұрын

    this is one of the best explanations of the HMM, it was very helpful to me, Thank you very much!

  • @ratnakarm200
    @ratnakarm2005 жыл бұрын

    Nice video with clear explanation. I can see lot of work & heart put into making this video.

  • @kimdinh8359
    @kimdinh83593 жыл бұрын

    This video is really useful for me to learn HMM as well as probability calculation with algorithms. The example is easy to understand. Thank you so much.

  • @user-de8ue5cs6s
    @user-de8ue5cs6s4 жыл бұрын

    my dad recommended i watch this, and i sure am thankful he did :D great video!

  • @amyrs1213
    @amyrs12132 жыл бұрын

    Your videos are very helpful and giving a good intuition of complex topics :) many thanks from Siberia

  • @mitchellphiri5054
    @mitchellphiri50545 жыл бұрын

    So I always just saw posts about HMM and I just decided to give your video a try and the explanations are just so fluid, I'm interested now

  • @rajvijay3276
    @rajvijay32766 жыл бұрын

    The content is excellent, so much hardwork ! Much appreciated :)

  • @i.d432
    @i.d4324 жыл бұрын

    What a clear way of teaching. You're a total Rockstar of teaching stats. Ok, let's do the Baum-Welch algo

  • @AmDsus2Fmaj7Am
    @AmDsus2Fmaj7Am4 жыл бұрын

    Excellent presentation. Simple to follow. I'll check out your book.

  • @Fdan36
    @Fdan363 жыл бұрын

    Really liked the video. Was looking to understand HMMs for neuron spiking and things are much clearer now.

  • @ebrukeklek3237
    @ebrukeklek32373 жыл бұрын

    Loved it. You are a great teacher. I was blessed finding your video first so I didn't waste any time 🥰

  • @FilipeMedeiros88
    @FilipeMedeiros886 жыл бұрын

    Thank you so much for share this video! It's the best explanation I found for this topic.

  • @AbeikuGh
    @AbeikuGh3 жыл бұрын

    I was quite tensed when my supervisor pointed out to me that my master thesis should incorporate HMM. This video is my first introduction to HMM. You chased my fears away with your simple explanation and tone. Forever grateful

  • @carlosmspk

    @carlosmspk

    3 жыл бұрын

    Similar situation here, I have a master thesis in anomaly detection, and using HMM is a candidate. I'm afraid it's much more complicated than this, but it sure made it look less scary

  • @hamidnikbakht1295
    @hamidnikbakht12952 жыл бұрын

    Great video! Thank you for spending time to make these videos.

  • @vinaysingh6664
    @vinaysingh66644 жыл бұрын

    Really Interesting and helpful video. Liked the way you took this topic from the basics and at the end moulded the concept of HMMs into the example making it so easy to understand and generalize to other sequences. Really appreciate the effort to make such a helpful and detailed video. Thank you for this resource. :)

  • @terryxychan
    @terryxychan5 жыл бұрын

    Love this video, it has been extremely helpful for my research! Thank you!

  • @qianyunwu221
    @qianyunwu2213 жыл бұрын

    THIS IS REALLY GOOD!!! Informative and easy to understand.

  • @balasahebgadekar425
    @balasahebgadekar4252 жыл бұрын

    Excellent, excellent. Great job. Your all videos enlighning to all academicians

  • @vardaanbhave2231
    @vardaanbhave2231Ай бұрын

    Dude, thanks a ton for explaining this so simply

  • @huayang9746
    @huayang97465 жыл бұрын

    Good Video easy explain those boring functions of hidden markov chain role and using example to explain is the best way

  • @yashrt
    @yashrt5 жыл бұрын

    Thank you so much! This video was very well made, its made understanding the concept a cake walk.

  • @surbhigupta1419
    @surbhigupta14193 жыл бұрын

    Awesome explanation...Just perfect for practical application...really commendable job...Thanks a lot for the effort ....!

  • @eludedieumaboungou5172
    @eludedieumaboungou51725 жыл бұрын

    Absolutely magic. Thank you !

  • @ashishgohil9717
    @ashishgohil97174 жыл бұрын

    Very nicely explained. It takes a lot to teach a complex topic like HMM in such a simplistic way. Very well done. Thank you.

  • @generationgap416

    @generationgap416

    Жыл бұрын

    Did you mean in such a simple way?

  • @omarkammouh-educationalcon4370
    @omarkammouh-educationalcon43706 жыл бұрын

    Thank you for the effort you spent in making this great video

Келесі