Markov Chains Clearly Explained! Part - 1
Let's understand Markov chains and its properties with an easy example. I've also discussed the equilibrium state in great detail.
#markovchain #datascience #statistics
For more videos please subscribe -
bit.ly/normalizedNERD
Markov Chain series -
• Markov Chains Clearly ...
Facebook -
/ nerdywits
Instagram -
/ normalizednerd
Twitter -
/ normalized_nerd
Пікірлер: 631
Since many of you are asking about the calculation of left eigenvector (π)...Here are the equations: from πA = π 0.2x + 0.3y + 0.5z = x 0.6x=y 0.2x+0.7y+0.5z=z from π[1]+π[2]+π[3] = 1 x+y+z=1
@arianakenzie4235
2 жыл бұрын
Dude you should collaborate with @ahmadbazzi
@putraduha3176
2 жыл бұрын
Thanks man, online school isn't really being nice to my brain
@dhruvsingla2212
Жыл бұрын
Hey, can you also tell how to code moving from one state to another based on probability? Like you did a random probability walk, how did the code decide which state to go to using probability.
@NormalizedNerd
Жыл бұрын
@@dhruvsingla2212 I think you are looking for this video: kzread.info/dash/bejne/eWt6q7NylrvSZrg.html
@dhruvsingla2212
Жыл бұрын
@@NormalizedNerd Great, thanks 👍
This is sooo easy to understand. I took atleast a month to learn this about 25 yrs back for my masters thesis work when I first learnt this subject. Now, I thought of revisiting this topic for my daughter's higher secondary project. 25 years have really brought a topic from masters to secondary school level and months of learning to a few minutes of a well prepared video. Thanks to your channel, KZread, Internet and technology in general. 🙏
@NormalizedNerd
3 жыл бұрын
Thanks a lot for sharing your experience. It really feels nice to read such comments. I'm glad have to have a platform like this.
@Fresh_Career_Compass
Жыл бұрын
Which institute is teaching this in secondary level.plz provide syllabus link .i am redesigning a syllbus
@Nuur_Rajput
6 ай бұрын
@@Fresh_Career_Compass yea. I'm curious too
@_rd_kocaman
4 ай бұрын
where the heck does this studied in high school?
@nshiba
4 ай бұрын
Sorry I missed all your comments. Markov Chains is one of the IA (Internal Assessment) topics to choose from for the HL (Higher level ?) Mathematics for IB (International Baccalaureate Diploma) programme ( which is higher secondary school level - Year 11 and Year 12) in Singapore. You can Google to find the details with the above information.
Thanks dude. It takes a whole nother level of intelligence to be able to break down a concept like this so anyone can understand it. I'm learning markov chains in class right now and when the professor teaches it it literally looks like an alien language to me, i almost broke down because i might fail the class. but im going to watch all ur videos and itll help me a lot.
@NormalizedNerd
2 жыл бұрын
Thanks a lot mate!
This is a lifesaver. I started a stochastics class last week with an almost nonexistent background in probability. I was completely troubled at first but after watching this video and reading through some course material, I can actually understand the exercises. Thank you.
Mate, that is a good explanation! The only problem is that now I AM HUNGRY:)
@NormalizedNerd
3 жыл бұрын
Haha XD
@69erthx1138
3 жыл бұрын
After burgers, Will took Skulyer for pizza, then give her a night cap with his hot dog.
@2highbruh
2 жыл бұрын
@@69erthx1138 oh, okay, good for him
@themathskompanyap4730
2 жыл бұрын
Subscribe for more such Markov chain concepts friends. kzread.info/dash/bejne/lJ9nr8x6c5y3o7w.html
@muhammadihsan6645
2 жыл бұрын
Woowww , human being human
Got way more excited than I should have when I thought "hmm, that kinda looks like the eigen vectors..." AND THEN IT WAS.
@NormalizedNerd
3 жыл бұрын
Haha...
@dnbhattacharya343
3 жыл бұрын
Holy crap we are nerdy.
Great explanation! A full series on the different types of Markov chains with explanations like this would be awesome.
@NormalizedNerd
3 жыл бұрын
I'll try to work on this
@themathskompanyap4730
2 жыл бұрын
Subscribe for more such Markov chain concepts friends. kzread.info/dash/bejne/lJ9nr8x6c5y3o7w.html
This is such a fantastic video. It makes all the concepts very easy to understand without skipping important technical details. Thank you for making such a great resource!
Wow great explanation that includes terminology, stationary states, and connections between adjacency matrices, directed graphs, and markov chains 👍 A+ thank you!
This video was really well constructed and interesting, in equal measure to being informative! Thank you Mr Nerd!
you have no clue how much you helped a bunch of online MS Analytics students. Thank you so much!
@NormalizedNerd
Жыл бұрын
I'm so happy to hear this!!
While i was trying to understand this i avoided complex terms the best i can but with this video i have no need to try avoiding it because of the thorough explanation typing this 2 years later the "whats up people of the future" really got me
I was trying to understand Evolution algebras and for that I needed idea of Markov chains. Beautifully explained. Thank you so much.
Omg man this is such a great explanation. Loved the presentation, the animation and everything about it. Keep going!
Jeez, if my professor had introduced Markov chains like this instead of spending multiple lectures talking about Google's page-rank system without any goal in mind, I would've saved myself a lot of confusion. Thank you!
Note for my future revision. Markov Chain models a system that changes its status. One important rule: the next status of the system only depends on its current status. Status = serve pizza, serve burger or serve hotdog = x, y, z = Connected, Disconnected, Terminated, Active Markov chain can be drawn as a state diagram. Or written as a transition matrix. State diagram represents all possible status and associated probabilities. Transition matrix = represent the state diagram = probability from one state to another = A At equilibrium, the probabilities of the next status doesn't change any more. The probability of state at equilibrium = Stationary Distribution. Let's call such equilibrium probability π. Aπ = π π = Eigenvector of the matrix = Probabilities of each status the system could be in, assuming equilibrium stage. Using two equations: A) Aπ = π B) sum of probability is 1, we can work out the value of π, i.e. the equilibrium probability Alternatively, run a simulation. A: Do all Markov Chain have a equilibrium state? Q: Don't know... Need to study more to find out... Q: Can I use Subscriber Status to as the hidden state? A: Yes. But if the status is known, then it's better to use it as the Observation states. Q: Can I "model" next status to be only depending on the current status? But then the next status actually also depend on the previous status, this seems contradictory. A: Yes, I can. At per state level, the next status only depends on the current status. But the at the system level and at equilibrium, it "depends" on both the current and the previous state, because the current states had been "affected" by the previous states.
@Ceratops17
Жыл бұрын
hii, maybe if you still need the answer. You can prove that an ergodic Markov chain, so a chain where all states communicate with each other and it’s aperiodic (gcd is 1) always has an equilibrium state.
@chaityashah4221
Ай бұрын
dont know if you revised it , but i surely did a revision
Good explanation, they never covered why am I calculating eigen values in high school, loved how that path and random walk converged in the end.
@NormalizedNerd
3 жыл бұрын
Thanks!! Yeah...they teach stuffs without their applications :(
@abc4924
3 жыл бұрын
You guys calculate eigenvalues at High school? Great!
@manishmayank4199
3 жыл бұрын
@@abc4924 my reaction was same...I studied eigenvalues in my 2nd semester of college
Found this awesome channel today. Fantastic visuals & crystal clear explanation. Subscribed!
This is a great video! I am currently having Linear Algebra II and Probability (2 separat courses) and this video perfectly connected them :) thank you!
@NormalizedNerd
2 жыл бұрын
Glad to hear that :D
That was one of the smoothest explanations i ever came across !
Very well-explained, appreciate your effort. Thank you for making this.
This is so cool. I'm getting into machine learning, and videos like these are extremely help. I've only really come across HMM for its historic use in Speech Recognition.
Dude, this is the first time I get the idea of Markov chain. Thanks a lot!!!
I am just starting to learn this. The best explanation of all the videos I have seen.. Very understandable. And there is the application to Python and Data Science as BONUS! I am subscribed and I want to see all of the videos now!!!
You make it clear and more intuitive. Thanks
This tutorial helped me with my NLP project on part-of-speech-tagging. Thank you very much!
@NormalizedNerd
2 жыл бұрын
Glad it helped!
You made it look so simple! Amazing man!
This is the best video ever. Seriously, I was ripping my hair about these concepts and this bridges each point beautifully.
excellent explanation. Just too good to be true. You have made an esoteric subject so simple
thanks a lot! incredible how you can explain a difficult topic in such an easy way!
Great content, thanks for sharing. Your education is helping lots of people. Keep going.
Awesome explanation!! It is so beginner friendly and I love it!! Thank you! and look forward to seeing more content from you!!
@NormalizedNerd
3 жыл бұрын
Definitely...More videos are coming!
Wow, thank you. Why was this so hard for me back in the day? Great job.
Thanks for the explanation. It's starting to make sense. Little by little.
I covered just 2 minutes of this and I'm so excited!!!
@NormalizedNerd
3 жыл бұрын
:D
You explained it to me like I am 5 years old. And that is what I needed. Thank you!
Thanks from the future! Great explanation, outstanding instructor!
Wonderful explanation! I love this visualization
You sir, just earned a subscriber. These kinds of quality videos and great explanation is what we love. Thank you. Best wishes from Nepal.
@NormalizedNerd
3 жыл бұрын
Thanks and welcome to normalized nerd :)
@themathskompanyap4730
2 жыл бұрын
Subscribe for more such Markov chain concepts friends. kzread.info/dash/bejne/lJ9nr8x6c5y3o7w.html
This was an amazing video. You're an outstanding instructor!
@NormalizedNerd
2 жыл бұрын
Wow, thank you!
It's a very nice video to understand the Markov chain model in a simplified way. Please make more such videos on the Markov model and stochastic process.
perfect explanation.. everybody can understand. this video may be the easiest explanation for this topic. THANK YOU !!!
wow this is the best technical video i have ever seen!! Well done!
What a great introduction to Markov Chains! Thank you, it was really helpful
woah, that was an awesome video man! I think i'll be watching your videos just for fun too! keep doing what you do 👍
Thank you so much, I really needed it and your video and great explanation and method helped so much.
5:24 I feel you bro, recording entire audio and then finding out about the mistake just at the editing ... I did the same, just cut words from other parts of the recording and put them to create a sentence... Thanks for the video btw, very nice.
@NormalizedNerd
3 жыл бұрын
Exactly bro :/
@rg31222
3 жыл бұрын
So true...so much time and effort goes into creating any content especially audio and video...great video and great channel.
Great video! As a physics graduate, it’s honestly surprising how often eigenvalues and eigenvector keep showing up in what I do!
@n-panda921
Жыл бұрын
ya! and you can really think this in terms of quantum mechanics too, I like all these connections
Really awesome. I never understood this topic as easily as you did.................. Thanks
Awesome video. Undergad student that really appreciates this simplification
very well explained. thank you for making this video
Thank you, this was very helpful. If you decide to expand on the video, the one thing that was not immediately clear to me, was *why* pi represents the stationary state probabilities. I had to write out the probability equations for that to become clear.
@NormalizedNerd
3 жыл бұрын
Thanks for this feedback :D
@RamakrishnanRukmini
2 жыл бұрын
That is the value reached by the system finally. No more variation. End state values. Hence stationary state.
Very concise explanation. Thank you.
Excellent demonstration. Really helpful. Thank you.
@NormalizedNerd
3 жыл бұрын
Thanks!
HI, could you explain why you took the middle row of the matrix A to find the values? would it work with the top and bottom rows?
Awesome video. Great presentation, clear explanation, and plenty of areas to grow from here. Thanks very much. Sub'd and looking forward to more content!
Well made and well visualized. Good job.
Cool video - watching the whole series now.
Great Explanation. Learned a lot from these! I would also like to ask for permission to cite your examples in a report I'm about to make in my masters class.
@NormalizedNerd
3 жыл бұрын
Yes, absolutely. Best of luck for your report :D
Hello, Thanks for the wonderful explanation. I have a naive question though, how did we arrive at the adjacency matrix and directed graph with probabilities in the first place? Is it from observations or domain knowledge(in this case, will restaurant give us the probabilities)?
Yes yes we want more with such interesting examples
Very good explanation with clarity. It will be greatly appreciated if you could include the script of these videos.
Can you convert an adjacency matric to a transition matrix? I have a 5x5 adjacency matrix with some numbers larger than 1 (due to multiple connections between states).
Informative and super clear!!! Thx!
"Please pause the video if you need a moment to convince yourself" What kind of 3blue1brown is that?!
Thank you only one thing I didn't get after πA = π and sum of probability is 1, how do we calculate the stationary state as π =[25/71 15/ 71 31/71 ] ?
Have to say this is a very very helpful video for understanding MCMC 🎉🎉🎉
my mind is blown!!! evry new thing that was covered in my course in the last 1 month just got used here!!!
@NormalizedNerd
Жыл бұрын
Haha...don't you like when that happens 😍
Great explanation . Thank you so much ..
Great explanation, please make more videos that go into greater depth.
@Normalized Nerd - Regarding the diagram at the 1:43 mark, why don't you have a transition arrow from the pizza state looping back to it as you do for the hamburger state and the hot dog state?
Life saver video 👍 prerequisite to understand markov regime switching model in econometrics
Lovely explanation and very clear in a simple way, would love to see more of these!
@NormalizedNerd
3 жыл бұрын
More to come!
@Deleted_Account_2023
3 жыл бұрын
Great to see you, prison mike! :D
@GhosT-sd6ji
3 жыл бұрын
@@Deleted_Account_2023 Haha, a pleasure!
@dhanushp1680
2 жыл бұрын
scranton branch is on fire
Thank you greatly! You're a great educator!
I'm here from ddlc and I could not understand a thing until I saw this video. Dude is the most helpful guy on this site
@NormalizedNerd
Жыл бұрын
So nice to hear that!
You saved my life! Thank you very much!
I am trying to do Markov Chain attribution modelling to classify conversion (1/0). Could you suggest a way to do this?
Nice video. I have implemented the Markov chains as neuromorphic Hardware,for implementation of Boltzman machine
Thank you so much for this great work👏🤝
This helped me so much! Thank you!
@NormalizedNerd
3 жыл бұрын
Glad to hear that!
You make it quite simple to learn👍 Can you plz make a detailed video on eigenvector and eigen values concepts?
Superb Explanation. Learned a lot from these!
@NormalizedNerd
3 жыл бұрын
Glad it helped!
For a general problem, how do you get A (or know the probabilities going from one state to another?) I see that you assumed values for each arrow, but for a different problem, I don't know where to get such values.
I really find it very interesting to learn from you. So can you make videos on TAR and STAR model also?
Great video! A quick question and I apologize if someone already asked it: Intuitively, I would assume that the probability of any given state is simply the sum of the probabilities for that state divided by the sum of the probabilities for all states. For example, the probability for pizza is 0.2, because 0.6/3.0. The answers you get from the pi calculation and the random walk are very close to this, but not exact. What gives?
Perfect explanation, thanks!
Reminds me a lot of 3B1B. Very helpful! Thank you.
@kstxevolution9642
Жыл бұрын
i can only assume he used 3b1b's engine for videos. its a brilliant bit of work
I watched the movie "Beautiful Mind'" and the random walk comes to mind, I found this quite interesting along with the Ignamac macine the Germans used and how it was the code was finally broken, and the consequences of giving away the code was broken and how that would effect WWII.
Thank you very much. More videos please.
Thanks a lot ! you have literally enlighted my path.
@NormalizedNerd
2 жыл бұрын
You're welcome 😊
perfectly explained, thank you!!
a great video to understand the topic easily
Perfect explanation!! Thanks!!
Fell in love with your channel and content quality....
@NormalizedNerd
Жыл бұрын
Thank you for your kind words :D
Impressive video! Helped me a lot!!
Very clear explanation! thank you!
@NormalizedNerd
3 жыл бұрын
Thanks dude!
great way to explaining sir tq so much...!!
good bro,you make me understand Markov model
Awesome video. Thanks!
Very clear explanation, well done! ty
@NormalizedNerd
3 жыл бұрын
Glad you enjoyed it!