Why neural networks aren't neural networks
There is a better way to understand how AIs sort data, process images, and make decisions!
Made for the 2021 Summer of Math Exposition: www.3blue1brown.com/blog/some1
Source code available here: gitlab.com/samsartor/nn_vis
The background music is an excerpt of the endless ambient generative music system "At Sunrise," available at generative.fm/music/alex-bainter-at-sunrise
Пікірлер: 484
"Let's watch that animation again, since it took me so long to make"
@pradiptahafid
2 жыл бұрын
as someone who is struggling with math, this is the equivalent of Picasso
@roseproctor3177
2 жыл бұрын
Lol it was a great animation though
@tielessin
2 жыл бұрын
Honestly, who can not relate haha
@mickolesmana5899
2 жыл бұрын
fair enough
@mxmilkiib
2 жыл бұрын
Yelped, paused, rushed to the comments to thumb up the one about that line.
First video? Off to a VERY promising start. This is just great! Hope low numbers won’t deter you from making more. (Or the amount of work.) Hope to see more from you.
@samsartorial
2 жыл бұрын
Thanks! I don't think I'm going to do a ton more, since it took me like a week of 14-hour days to make. But I was thinking I might do a video on transformers NNs or something unrelated like reactivity in user interfaces once the semester wraps up. IDK, we'll see.
@roygalaasen
2 жыл бұрын
@@samsartorial I do understand and appreciate that it is a lot of work. I am glad you took the time for this one video at least! 😃
@piter239
2 жыл бұрын
Is there a way of increasing the possibility of future videos of this exquisite quality?
@romanemul1
2 жыл бұрын
@@samsartorial Lemme tell you. Noone wants from you to make a video in a week or a month. Just make them slowly. Otherwise you end up like 3b1b . Looks like he is at the end of ideas.
@RonWolfHowl
2 жыл бұрын
@@samsartorial Those both sound like very exciting topics 😁
Even after doing ML professionally for 5 years, seeing the transformations in this way taught me something new.
@revimfadli4666
Жыл бұрын
You might like reading Chris Olah's blog then
Oh jeez, this is such a great video, I love how you describe the weighting process in NN to actual weights...brilliant. At the beginning you actually describe linear discriminant analysis as well. This is great because NN is really just a series of transforms and this is the best animation I have ever seen, way better than event Grant Sanderson's video on the topic. I added this to the list of all SoME1 videos that I could find. @
@patrickinternational
2 жыл бұрын
kzread.info/dash/bejne/f6eCs9ajY928o5s.html
@Walkofsoul
2 жыл бұрын
@@patrickinternational Thanks !
@vtrandal
2 жыл бұрын
Off
@alejrandom6592
2 жыл бұрын
Not better, but they complement each other
@Artaxerxes.
2 жыл бұрын
I don't think there's a better video than 3b1bs linear algebra series to understand linear transformations. This video makes sense only if you've understood that already. And it's perfect to watch once you've done that. I wish he makes more because it was very enjoyable although it lasted only for 10 min
This is a great video. I work with neural nets daily and intellectually knew everything you said in this video, but your presentation and visualizations has completely reframed the way I think about NNs. Thank you!
hey sam , its marvelously clear , fluid and relevant ,we need more of anything you find interesting sincerly -everyone
I've been reading about neural networks for years with limited understanding. In 10mins you have given me an entirely new and easier to understand perspective. Thank you so much! Fantastic work!
I have worked extensively with linear and nonlinear transformations of abstract geometries, and this is by far one of the best explanations of their correspondence with “neural networks”!! Great work!
Very well done video, definitely feels on par with 3b1b's ability to break up and explain complex phenomenon.
really great! hope you make some more videos :)
@matejnovosad9152
2 жыл бұрын
Did not expect to find you here
@matejnovosad9152
2 жыл бұрын
MC Speedrun mods are truly everywhere
@junkokonno
2 жыл бұрын
based
@karolakkolo123
2 жыл бұрын
Geosquare go expose some more speedrunning scammers or something
As someone who took machine learning in college, I have recollections of being surprised when we covered a bunch of techniques and every single technique boiled down to statistics, not only in how they worked but also in proving why they worked (or didn't) for different scenarios.
I understand more about linear and non-linear transformations, why hyperbolic tangent is useful in NNs, and how NNs really work thanks to this video. Awesome work!
This video is wonderful. I am very glad you took the time to visualize these transforms into animations. You are a great teacher!
As someone who has used neural networks in a research setting, I never even realized that neural networks are actually just a series of alternating linear and nonlinear transformations. Amazing video, hope you make more :)
@DeadtomGCthe2nd
2 жыл бұрын
How does that happen? Brilliant teaches this.
@Finnnicus
2 жыл бұрын
@@fuzzylogicq You're very smart 🌟
This is frickin amazing, I just completed a postgrad in which we were just expected to accept the transforming data was viable. Whilst I mathematically understood it, I never intuited why - a few minutes into this video you visually slapped me in the face and showed me how it is obviously the same as transforming your boundary! I feel both foolish not to have seen it before and so elated!
Hey, just wanted to let you know this is one of my favorite videos on KZread, I absolutely fell in love with it. I come from Statistics so when I was first learning about "Neural Networks" and found out that the process of "learning" is literally just minimizing a cost function, that it has no magic going on, my thought was "So it's just MLE? It's just a Math thing?" This video is the best piece I've found so far in demystifying neural networks, plus it gives some insight on what's actually going on, besides the usual neuron-layer analogy. That's all!
@WelcomeBub
2 жыл бұрын
Well the field of AI has many more characterizing questions for choosing machine learning methods and models for a problem. For example how do you incorporate new knowledge/data for a trained neural network? NNs aren't really fit for this job at the moment and require relearning everything with the new samples.
I love your explanation here. This kind of simplification and visualisation an excellent way to break down some of the barriers around machine learning and expose more people to the processes involved, their limitations and applications. Bravo!
I come back to this video often because your animation of an NN transforming the data is just so satisfying.
Fantastic video. I’m extremely impressed, especially with that visualization you worked hard on. Great job, hope to see more videos from you soon!
What an underrated gem from KZread recommended! Please make more on similar topics your style and presentation is very clear and interesting!!! Best of luck hope to see this channel grow👍👍
I can’t believe that this your first video with how much of a great quality it has. Keep making more, you’re amazing!!
even though I do not know how linear transformations work(but this inspired me to do so soon) and only knowing the relevant calculus of machine learning, this is really mindblowing. I see how much thought was put in there and I thank you for your time and wish you a great life
THISSSSS!! OMG my mind is blown to pieces even though I sort of already knew the information never have I seen anyone put the pieces together like this. My man thank you so much.
Unbelievably amazing video. I thoroughly enjoyed it and learned to look at some parts of AI in a different way. I seriously hope you continue making videos! Great work!
This video was great! I hope you take it as a compliment that for a second, I thought I was watching 3blue1brown. I understood activation functions coming in to this, but I still feel that I have even more clarity after your animation. Thanks!
How is it possible that I watched so many different videos explaining ML without really grasping it, and now this guys with 9 minutes makes it so clear. Thank you. PS. just a clarification: the use of the analogy with neurons was kinda on point at the time it was created, because they were trying to understand how living organisms were self organising, hence also trying to create a model of the neurons and the brain.
Fantastic video! I love the 3b1b-esque elegance, emphasis on visual intuition, and the build-up to a worthwhile nugget of insight (neural nets aren't magic, just iterated linear and non-linear transformations). Looking forward to your future videos!
Excellent! Especially the part „Let’s play this animation again because it took me so long“ 😂
Extremely well done video. I hope you make more! I've taken some classes in Machine Learning and use some simple NNs at work so I have some familiarity with the mechanics, but it's nice to see the concepts so neatly spelled out! Very illuminating.
This is one of the best videos I have seen on the topic, please make more
Great video. Keep them coming. This will significantly aid my ongoing “ML is just statistics” campaign. Thanks. Subscribed.
2:07 suggestion - probably more clarification needed on logical regression and linear regression terminologies. The word 'regression' pretty much always is used for prediction, not classification. Logistic Regression is a classification method and not prediction, so it's sort of a misnomer due to historical reasons from what I've heard.
Absolutely incredible. I also can't think of any berries with those growth patterns. I love how obvious it became that projecting into a higher dimension was important.
The single best video ever made on machine/Deep learning. Extremely intuitive and practical explanations and visuals. Well done.
Great video man! I like the explanation of the backstory of the name. It helps to give the whole concept some context
Your video made it click in my brain like only 3blue1brown could make when explaining the fouriertransforms. My mind is blown, it makes sense now. Thanks.
How you introduced the scale for classifying the fruits by just one number and therefore introduced logistic regression was just pure genius!
You changed my understanding of how I saw neural nets before. Amazed..🙏 would wait for more videos
This video is amazing; I'm sharing it with so many people. I've gotten so tired of seeing the nodes/edges diagrams as an explanations of neural networks--I understood that one layer influenced the next one to get to a final result, but it bothered me that I never understood *how* or *why*. Your explanation in this video is exactly what I was looking for. Thank you!
This was superb - at some level this demystified for me how the hidden layers do the work - at least when the dimensions are small - just wonderful clarity in this video
The video was awesome! Sam, you have gift for this, I can totally see your videos teaching millions in few years
Wow, this is incredibly well made! I'm going to subscribe in the hopes you make more like it!
Great video, I especially liked the transitions from one topic to the next, and the animations.
This one of the best videos I have seen in a while. I really hope you will make more 🙏
Brilliant exposition. Will certainly help to blow away the fog of confusion that other sources may have, or have, generated. Thanks for your hard work!
Amazing Video! I started studying AI recently and this has given me a new perspective on the topic.
As a teaching assistant for a deep-learning course, I am definitely referring this video to the students. Gives a very interesting perspective into what NN are, and why we use activation functions.
Great visualization; I had to stop what I was doing and watch because I realized it made so much more sense now
Fantastic video, it may have taken you a lot of time but it was absolutely worth it! Subscribed in case you do decide to make more.
What a *fantastic* video! I've watched a large number of videos on artificial neural networks over the past few years... yet I learned such a lot from this one! Such a (shockingly) clean perspective on how these systems work. The choice of the examples and the clarity of the writing and animation are just superb. If you didn't win, it's a travesty.
Fantastic explanations and visualizations. Thanks for all the time & effort you put into this.
Thanks for this, it demystified the concept quite a bit for me!
Such a great video Sam. Thanks for making this 🙏🏻
What a great video! And you only have a single upload! How do you make such an amazing video and explanation without previous uploads
Great stuff. More power to you. Looking forward to more such amazing videos.
this is amazing, very good and intuitive animations, keep up this amazing work
I only just recently realized that neural nets were just transformations between dimensions and it made so much click. The idea that there exists an information space that can encode data about whether an animal is a cat or a dog was crazy to me. Keep up the good work
Amazing ! Please keep it up, we have so much yet to learn.
This is the most intuitive video I have ever seen.
Amazing! Hope you make more!
This is by far the best and most concise introduction to Machine Learning, Deep Learning and "AI" that I've ever seen. Great job!
Great work! Hope to read more from you
Just awsome!!! I have been thinking about neural networks this way, and how the key word has stuck with this statistical process. You illustrated beautifully just amazing!!
This is seriously the best NN video I've seen, and yes that's after watching 3B1B's series
This example is very cool. With enough transformations you can separate out almost any data set.
That's why we have "neural" (built from neurons) and "neuronal" (built from a simplistic models of neurons) networks distinction in some languages.
This is amazing. I don't know anything about neural networks, but these are concepts I can understand, at least partially.
This is the most beautiful video I have seen in several years. Thank you so much for sharing this enormous observation and perception! Thank you so much!!! ❤️
Love the visualisation and explaination. Thanks for making the video. :)
Damn I really loved this video! You summerized everything I always say to people when explaining them what artificial neural networks actually are, how they are really different from biological neural networks and why I don't like the metaphor of "neural networks" to describe them, but with great animations! Now I have this reference video to share when someone else brings the topic. Thanks for this really great video!
Hey Sam! Great to see you're doing well, hi from the old Mines LUG crew!
AMAZING! The animations and explanation are perfect! Thank you for your hard work
Wow! This is amazing. Thanks for providing a logical perspective for NN's :)
Wow. Well done. I'm currently studying machine learning and this is a great introduction to many concepts at a high level.
hey sam, superb video! I am studying mathematics and i am scratching the surface of the neural network thing from time to time. the block from 5:53 to 6:16 made it super clear for me what neural networks actually are and the first real definition i've seen. It's demystifying and clarifying. I am definitely gonna build upon this concept! huge thanks :)
Wow, awesome quality and very clearly explained
This was so thoughtfully put together. Consider me inspired
Wow this is Gold! Thanks for the video!
Man! That video to put it lightly, pure awesomeness!
That was absolutely fascinating and amazingly well done! I'd pay for course about this!
This is top notch! Hope you make more educational videos
Professional Data Scientist here - very well done. And, a useful clarification - too much magical thinking out there regarding AI at the moment. Vids like this are a big help. Thanks
Thank you for this amazing piece of knowledge Sam Sartor. Subscribed, maybe you are devoting some time in the future for other projects of this type. See ya!
Great explanation, very intuitive. Thanks for the awesome content, I've subscribed so I'm looking forward to more
Im hoping for more videos, the visuals are great and clean.
This is gonna be an amazing channel :)
This is beautiful. I understand these things better now. Thank you.
fantastic video, keep making them! Especially on the topic of AI
Please keep sharing your knowledge with us, you are just awesome, and we love your content.🙏
I thought this was 3Blue1Brown the whole time! Good job!
How do you only have 494 subscribers!!?! Amazing content
Amazing video. Thank you for making it
That music is really amping up the tension
Great work! Loved the presentation
Incredible clever AND insightful! I just love it!!! Why so few views?!?
Love this video so much, such a high quality product. Thank you!
Incredible. Well done!
So uh, we actually have pretty good ideas about how neurons change in response to activity. Signals generate electrical/protein activity in neurons which can lead to secondary signals that alter protein expression patterns, which in turn alter electrical activity for the same original signal. The trouble of course is that each neuron has different initial states; though, they can be classified broadly and interpreted as classes of neurons which behave in particular ways. These alterations modify the weighting of edges in your brain's network the same way true computational neural networks need modify their edges' weighting. Learning then is simply giving training samples and rewarding good matches, which fits in the scaffolding theory of learning of Vygotsky and Bruner quite well.
@WelcomeBub
2 жыл бұрын
But for neural networks we don't really have continuous learning, only hitting the reset button and changing up the samples. Applying a NN model does not also trigger learning in the process; the result of the application is simply used to nudge the model's weightings somewhat.
@diadetediotedio6918
Жыл бұрын
Nah, we really don't have such good ideas of what neurons do or how they change exactly.
Great video ! This is a very intuitive approach to neural networks. Thank you
Wow! Awesome video. So intuitive. Thanks a lot