Logistic Regression - VISUALIZED!

People talk about "sigmoid functions", "decision boundaries" and “Training”. But what exactly is happening behind the scenes? Let’s see for ourselves!
Please SUBSCRIBE to me for more content!
Shoutout to 3blue1brown for creating his animation math engine “manim”. Give this a * on your way out: github.com/3b1b/manim
REFERENCES
[1] My previous video on Details of logistic regression (I’ll make another one soon): • Logistic Regression - ...
[2] More on Generalized Linear Models: www.sagepub.com/sites/default...
[3] Logistic Regression & GLM: newonlinecourses.science.psu....
[4] Overfitting problems in Logistic Regression: courses.cs.washington.edu/cou...
[5] More info: byrneslab.net/classes/biol607/...

Пікірлер: 62

  • @ulrikeschnaithmann3914
    @ulrikeschnaithmann3914 Жыл бұрын

    This visualization is so strong, I feel like it's like one of those lecture in university that were so good, you'll never forget them!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Thank you for the amazing compliments! I definitely tried a lot with this one haha

  • @matthiasmitchell4801
    @matthiasmitchell48013 жыл бұрын

    This is insanely helpful. I feel like I can actually use logistic regression libraries and have a good idea of what's happening. Generalizing this to higher dimensions was eye-opening--I never quite knew what was going on there.

  • @adityagitte
    @adityagitte5 ай бұрын

    This video is exactly what I was looking for, I was getting confused between decision boundry and the sigmoid function for a 2d input problem, thanks a lot for the wonderful animations!

  • @iyar220
    @iyar220 Жыл бұрын

    I'm currently self studying machine learning, and the very first thing I did after learning about decision boundaries was check if 3blue1brown had a video on it, because his animations are just incredible for understanding math and gaining intuition. The way this video is constructed, and again, the animations used in here are incredible. Thank you so much for making this!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Glad you liked the visuals here. Honestly creating this video solidified my understanding of this as well :)

  • @darasingh8937
    @darasingh89372 жыл бұрын

    Great video! Thank you for your time and creativity!

  • @mysillyusername
    @mysillyusername Жыл бұрын

    A brilliant visualization of the logistic regression, thanks for making this!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    My pleasure :)

  • @olusanyatodd4083
    @olusanyatodd40832 жыл бұрын

    Oh wow! This is so great! I just learned the math in a class but this really explains the intuition! Thank you so much

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    Of course :) Thanks for watching

  • @alexanderdellorti6039
    @alexanderdellorti6039 Жыл бұрын

    Thank you mate, I think visualization is so underestimated in universities, in math and science THIS is the key of teaching. Great job!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Thanks for the kind words. I thought this video didn't receive the attention I thought it should have. But glad there are others out there like you who find value here. :)

  • @arpitsahni422
    @arpitsahni422 Жыл бұрын

    simply lovely mate! this helped me connect everything

  • @aniketchhabra8912
    @aniketchhabra89123 жыл бұрын

    This is amazing!! Thanks a lot for sharing

  • @BiranchiNarayanNayak
    @BiranchiNarayanNayak4 жыл бұрын

    Excellent explanation of Logistic Regression

  • @clearwavepro100
    @clearwavepro1004 жыл бұрын

    Thank you! Super helpful on a lot of levels :)

  • @jose4877
    @jose48773 жыл бұрын

    This was very cool! Thank you!

  • @mohanakumaran5815
    @mohanakumaran58154 жыл бұрын

    I really love this channel 😘 Pls post many videos often, not once in blue moon 😁

  • @CodeEmporium

    @CodeEmporium

    4 жыл бұрын

    Super glad you do! Had some life changing events come in the last few months (graduation, move, new job). But now that things have settled, I'll be more frequent. :)

  • @shubhamsingh6884
    @shubhamsingh68844 жыл бұрын

    Great video. It really helped me to get a better understanding of logistic regression. However, I have a couple of queries - What is the target function of logistic regression which s being learned (like in linear regression we have y = w.T*x)? To what curve do we fit the training data, the decision boundary of sigmoid function (like in linear regression we fit the straight line defined above)? Thank you !!!!

  • @RiteshSinghArya
    @RiteshSinghArya Жыл бұрын

    Beautifully explained

  • @emilycoppens4603
    @emilycoppens46033 жыл бұрын

    This video was great, thank you

  • @hypebeastuchiha9229
    @hypebeastuchiha92292 жыл бұрын

    This video deserves a million views

  • @apoorvshrivastava3544
    @apoorvshrivastava35444 жыл бұрын

    dude please be regular You will earn more subscribers as you desrve million of subscribers keep it up

  • @CodeEmporium

    @CodeEmporium

    4 жыл бұрын

    Thanks a ton! I had some life changing events take place in the last few months (graduated, travel, moved, new job). Now that things have settled a bit, I can be more regular :) Thanks for the support. Means a lot!

  • @patite3103
    @patite31033 жыл бұрын

    You've done an amazing video! At 14.40 you show a plot in 3 dimensions. On the z-axis (vertical one) the values should spread on the interval [0,1] which is not clear here. It's not clear why the boundary is not a plane since we have a scatter plot in 3 dimensions. I'm quite confused with the dimensions of the plot.

  • @taiworidwan194
    @taiworidwan1942 жыл бұрын

    Thanks for the video. It is really helpful Please, how can one optimize the coefficients of a Logistic Regression Model using a Genetic Algorithm?

  • @amoughnieh
    @amoughnieh Жыл бұрын

    Thank you so much for this video!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    You are very welcome. Thank you for watching

  • @X_platform
    @X_platform4 жыл бұрын

    These visualizations are hot! Love both of your channels :)

  • @kpratik41

    @kpratik41

    4 жыл бұрын

    which is the other channel?

  • @X_platform

    @X_platform

    4 жыл бұрын

    @@kpratik41 3blue1brown

  • @urfiyogabama2589
    @urfiyogabama25893 жыл бұрын

    Great!! Thank you

  • @Leibniz_28
    @Leibniz_284 жыл бұрын

    17:32 ¿"m" dimensions or "d" dimensions? Great video, your content is really high quality

  • @CodeEmporium

    @CodeEmporium

    4 жыл бұрын

    Yup. I didn't write m because I didn't want to confound this with the "m" in number of iterations.

  • @soryegetun529
    @soryegetun5292 жыл бұрын

    awesome explanation thanks so much

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    You are so welcome

  • @tawhidshahrior8804
    @tawhidshahrior88042 жыл бұрын

    DUDE YOU ARE A LIFE SAVER. Subbed and reccommended to my fellow msc colleagues. Keep up the great work brother.

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    Thanks a ton for the share :) And so happy this helps

  • @skewbinge6157
    @skewbinge61572 жыл бұрын

    thank you so much

  • @PremKumarAmanchi
    @PremKumarAmanchi Жыл бұрын

    Can u make a video which explains the plot for 3 labels using 2 features, I am just curious how the sigmoid function looks for it. Amazing work!!!

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    Thanks so much for watching! I’ll keep your suggestion in mind and see if there is leeway to do this at some point (tho I don’t think it will be anytime soon admittedly).

  • @Tntpker
    @Tntpker2 жыл бұрын

    The visualization at the end is what wee need more off

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    Glad you like the visuals!

  • @bytesizebiotech
    @bytesizebiotech4 жыл бұрын

    Love your stuff. I'm not a math major, and I've learned that you don't have to be to understand, but it's kind of offputting when people use a ton of symbols. It's not necessary to explain what is going on

  • @romanmelnyk1777
    @romanmelnyk1777 Жыл бұрын

    Why decision boundary doesn't depend on activation function? So if i want to have a curved dicision boundary, i don't have to change activation function, but rather change my features?

  • @muhammadusman5521
    @muhammadusman5521 Жыл бұрын

    Please explain how the value for bias and weigh are calculated That sigma there If n is also 1 Then y1 and x1 What are there values Please I want to calculate and loop them like you did

  • @amarnathjagatap2339
    @amarnathjagatap23394 жыл бұрын

    Sir it's amzing make more on ml

  • @josephfdunphymba3241
    @josephfdunphymba3241 Жыл бұрын

    not seeing a link to visualization program

  • @kdang7233
    @kdang7233 Жыл бұрын

    why do we need to use e^-x instead of any f(x) >=0 with every x to express the possibility, I forgot all the math learned from highschool so At This Point I'm Too Afraid to Ask

  • @javxa
    @javxa3 жыл бұрын

    Oh boy, this visualization is incredible. I always knew there was a sigmoid function in 2D. Guess what... It was hidden in 3D LOL

  • @CodeEmporium

    @CodeEmporium

    3 жыл бұрын

    The mystery has been solved by Detective Emporium.

  • @ermiassolomon7605
    @ermiassolomon7605 Жыл бұрын

    what is the book in the beginning of the video?

  • @CodeEmporium

    @CodeEmporium

    Жыл бұрын

    That wasn’t a book; just me listing out some topics :)

  • @vijayendrasdm
    @vijayendrasdm3 жыл бұрын

    loved the explanation. But, why do we use sigmoid function ?

  • @balajikannan7393

    @balajikannan7393

    3 жыл бұрын

    A sigmoid function transforms any real number to be between 0 and 1. In other words probability would lie between 0 and 1.

  • @vijayendrasdm

    @vijayendrasdm

    3 жыл бұрын

    @@balajikannan7393 There are thousands of function that can map real number to a number between 0 and 1. For example Step function being one of them. Then , why pick sigmoid out of hat ?

  • @jeverly

    @jeverly

    2 жыл бұрын

    @@vijayendrasdm sigmoid function is differentiable which allows us to train our weights using gradient descent, step function is not differentiable

  • @Simon-mv6zn
    @Simon-mv6zn Жыл бұрын

    9:03

  • @viddeshk8020
    @viddeshk80202 жыл бұрын

    Bro, please use dark theme

  • @CodeEmporium

    @CodeEmporium

    2 жыл бұрын

    I do now. Recent videos