Markov Chains: Simulation in Python | Stationary Distribution Computation | Part - 7

So far we have a fair knowledge of Markov Chains. But how to implement this? Here, I've coded a Markov Chain from scratch and I've mentioned 3 different ways of computing the stationary distribution!
#markovchain #datascience #python
Like my work? Support me -
www.buymeacoffee.com/normaliz...
For more videos please subscribe -
bit.ly/normalizedNERD
Notebook -
github.com/Suji04/NormalizedN...
Markov Chain series -
• Markov Chains Clearly ...
Join our discord -
/ discord
Facebook -
/ nerdywits
Instagram -
/ normalizednerd
Twitter -
/ normalized_nerd

Пікірлер: 39

  • @chinmayrath8494
    @chinmayrath8494 Жыл бұрын

    This is an absolutely great channel. i was reading page rank in the university and thought i understood markhov chains well, but upon watching your video i realised there was so much more intuitive things to learn, Thanks a lot!!!

  • @elenasmirnova2623
    @elenasmirnova2623 Жыл бұрын

    Absolutely great, useful and easy to follow. Many thanks!

  • @Mutual_Information
    @Mutual_Information3 жыл бұрын

    Excellent! The eigenvector perspective is cool - shows how they, once again, reveal the most important characteristics of a system.

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Yeah...exactly!

  • @thanawutth
    @thanawutth2 жыл бұрын

    Great Video! Thank you

  • @mgetommy
    @mgetommy3 жыл бұрын

    Lol just solved this problem for my code right before you posted this video! Your explanation would have saved me a decent amount of time

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Haha...it happens XD

  • @folkertendtz2740
    @folkertendtz2740 Жыл бұрын

    Man your outro is awesome!

  • @JavierGaleano
    @JavierGaleano2 жыл бұрын

    Great video! I have a doubt. I think the probability function should be divided by "len (seq)", do I?

  • @eduardoduarte9230
    @eduardoduarte9230 Жыл бұрын

    Just a question. If I would like to find outlier sequences, say, the ones with a very low probability, it is clear that I just need to use your last example and calculate some kind of percentile threshold on my dataset of probabilities of chains to isolate the outliers. I am dealing with sequences of different length, so, bigger sequences will naturally tend to 0 due to the fact that probabilities are between 0 and 1. The question is... I am using geometric mean of the transitions, this is, after multiplying all the probabilities like you do, I calculate the nth root of that product, this to get a "better value" that is not affected by the chain length (in this case n where n can be between "a" and b" for some a,b) in order to be able to compare them, is this the correct approach for this problem ? Thanks

  • @prod.kashkari3075
    @prod.kashkari30753 жыл бұрын

    How could I plot a graph of the random walk over each iteration?

  • @facundofelix5918
    @facundofelix59183 жыл бұрын

    Great video! Greetings from Argentina

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Thanks mate! :D

  • @xviruzz_platinum151
    @xviruzz_platinum151 Жыл бұрын

    Supose that we a huge A matrix (realy big dimension). Would be faster/cheaper to use the nontecarlo aproach rather than finding the eigenvectors?.

  • @marefatmansouri9289
    @marefatmansouri92896 ай бұрын

    Thank you for your Video, I just want to know some more details of the last part. In how many iterations of the Markov chain do you expect that see the specific random walk? As we know by increasing the iteration of random walks it would be more chance to appear spesific random walk. can you please clear this part?

  • @TheDunningKrugerEffectisReal
    @TheDunningKrugerEffectisReal19 күн бұрын

    To quote South Park: "Pizza, french fries, pizza, french fries....see? he should of done pizza instead of french fries."

  • @afk4dyz
    @afk4dyz2 ай бұрын

    How do you determine the probability of the transition matrix?

  • @angitd3766
    @angitd37663 жыл бұрын

    U r the best

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Keep supporting :D

  • @kartikeybisht1309
    @kartikeybisht13092 жыл бұрын

    can you make video on HMM practical implementation please

  • @kaushclar4189
    @kaushclar41892 ай бұрын

    is it possible to trade NIFTY india using MARKOV chain ? mostly on the LONG side?

  • @JohannesLippmann
    @JohannesLippmann3 жыл бұрын

    Method 2 curls my nails a bit. Instead of of multiplying A many times you could just square A again and again, which will lead to A^(2^n) after n steps. That would be so much faster.

  • @simonmasters3295

    @simonmasters3295

    2 жыл бұрын

    Good point, but at this level of matrix dimensionality it computes fast enough anyway...

  • @roc7880
    @roc788011 ай бұрын

    can you make a full course on stats and coding? i would be wiling to pay for the service. thanks for the content.

  • @anushaganesanpmp7602
    @anushaganesanpmp76022 жыл бұрын

    can you make practical implementation video on HMM please

  • @mgetommy
    @mgetommy3 жыл бұрын

    I don't know if you mentioned, but google's search algorithm uses these stationary distributions!!

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Yeahh!...No, I didn't mention that in this video.

  • @divyanandlalsahetya9324
    @divyanandlalsahetya93242 жыл бұрын

    Is there a way of verifying the values of stationary state?

  • @simonmasters3295

    @simonmasters3295

    2 жыл бұрын

    He's just shown you three methods. If they agree, no problem. In an earlier vid if the system is oscilatory the stationary state will not settle.

  • @punyashreebasappa5661
    @punyashreebasappa56612 жыл бұрын

    How to run this

  • @gaurangmohta168
    @gaurangmohta1683 жыл бұрын

    Hi. Awesome videos! Which college are you/were you from?

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Kalyani Government Engineering College.

  • @arichandranr3626
    @arichandranr36262 жыл бұрын

    Hi. How to do it for time series data?

  • @simonmasters3295

    @simonmasters3295

    2 жыл бұрын

    Very good point, especially where the states have long lives or variation time between or in transition

  • @SF-fb6lv
    @SF-fb6lv2 жыл бұрын

    I can has Baum-Welch algo next pls?

  • @mauriciobonatte8601
    @mauriciobonatte86013 жыл бұрын

    Why didn't you use FOR loops instead of WHILE loops?

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Haha...no specific reason

  • @mayurdeo627
    @mayurdeo6273 жыл бұрын

    Last time it was a hamburger and not a hot dog😂

  • @NormalizedNerd

    @NormalizedNerd

    3 жыл бұрын

    Really? 😂😂