Visualize Spectral Decomposition | SEE Matrix, Chapter 2

A video illustrating the underlying elegant visual interpretation of Spectral Decomposition.
Chapters:
0:00 Chapter 1 Summary
1:23 Symmetric Matrix ?
1:44 Property of Transpose
3:27 Matrix Decomposition
4:58 Eigen Vectors and Eigen Values
8:07 Strong Property of Symmetric Matrix
9:36 Spectral Decomposition
12:03 Visualization
14:13 appreciation
Video Sins:
1. regarding the eigenvectors of symmetric, it is correct to say the eigen vectors are orthogonal if the matrix is full rank. However, the formal definition is there always exist a orthornormal basis which contains the eigen vectors of the symmetric matrix, for details refer to • 25. Symmetric Matrices... , where professor Strang explains the case with eigen vectors with eigen value of 0.
2. 00:50: a diagonal matrix is also a symmetric matrix, and its visual interpretation is very straightforward. So it’s definitely not correct to say every symmetric matrix produces a visually complicated transformation. But normally when we address a matrix as a symmetric, we often mean “symmetric and non-diagonal”, if the matrix is diagonal, we would just call it diagonal matrix.
3. 2:46, the transpose of orthogonal matrix is also a orthogonal matrix. I didn’t mention this fact.
4. 7:42, when the eigen value is 0, it means the vector is in the null-space, pretty important fact, which I didn’t mention.
5. 14:20: the visual interpretation of matrix decomposition doesn’t apply to every type of matrix decomposition. Most matrix decomposition are often used for speeding up computational purposes, for example the LU decomposition.
6. Order of eigen vector could be swap, so there are many alternative decomposition of symmetric matrices.
This video wouldn’t be possible without the inspiration of the legendary 3b1b :
/ 3blue1brown
and the animation software - Manim, which he wrote:
/ 3blue1brown
and the Manim Community:
docs.manim.community/en/stabl...

Пікірлер: 166

  • @swagatochatterjee7104
    @swagatochatterjee7104 Жыл бұрын

    I literally have zero ideas, why does this series have so less views. This is literally the best extension to 3b1b's Linear Algebra series. This is exceptionally exquisite! Subbed!

  • @visualkernel

    @visualkernel

    Жыл бұрын

    EoP (Essence of Linear Algebra) is exactly what inspired this series. I never want to compare anything I make to the legendary 3b1b, but your comment were spot on, I hope this series can somewhat be an informal extension of of EoP. Just like in most college course linear algebra course, the first half focus on things like (vector, range, null space, determinants, linear dependence); the second half of course is almost exclusively focusing on matrix decomposition, and personally I thought the visual interpretation of them were equally valuable hence this series. Appreciate your very encouraging words, did you check out SVD by the way ?

  • @swagatochatterjee7104

    @swagatochatterjee7104

    Жыл бұрын

    @@visualkernel yes. It was exactly what I needed to know. I always wanted to know why all of a sudden doing the eigen decomposition of AA^T was thought of to calculate the SVD. Now I understand.

  • @ssssssstssssssss

    @ssssssstssssssss

    Жыл бұрын

    He needs to put out more videos. Viewers will come but not with just four videos. He’s got to consistently put them out.. I think he has a ton of potential.

  • @LexiZ0708

    @LexiZ0708

    Жыл бұрын

    I feel like it's because most intro linear algebra courses only cover the more basic stuff that 3b1b had already covered.

  • @vnitian2233

    @vnitian2233

    Жыл бұрын

    hlw swagato sir, where are you from?? guessing you're A Bengali but from where??

  • @hansenmarc
    @hansenmarc Жыл бұрын

    I think 3B1B would be proud. This provides very nice intuition into how to think about spectral decomposition and the role of symmetric and orthogonal matrices in it. Well done, sir! 👏👏👏

  • @visualkernel

    @visualkernel

    Жыл бұрын

    thanks buddy !

  • @lakshyadugar1522
    @lakshyadugar152223 күн бұрын

    Probably the best video I've come across explaining this. This not only made SVD crystal clear but also cleared so many other concepts within Linear Algebra not even directly related to SVD. So glad to have come across this. Looks like you haven't uploaded in a couple of years, hoping for new videos!

  • @darshan5044
    @darshan50448 ай бұрын

    Brilliant. I don't understand why the geometric interpretation is treated as if it doesn't exist in schools. Thank you a lot!

  • @Automan9
    @Automan95 ай бұрын

    God fucking damn bro. Even my two brain wrinkles managed to understand the intuition behind decomposition. The most elegant explanation I've ever seen of the subject, and the lead up to it with all the topics was masterful

  • @Colby_ye
    @Colby_ye5 ай бұрын

    The music note analogy is such a beautiful way to explain the decomposition of matrix transformations! Amazing video!

  • @leticiabarbaneramenezes2751
    @leticiabarbaneramenezes27516 ай бұрын

    this series has just become the best videos I've EVER watched in my life! Never thought I'd cry in the middle of my Uni's library bc i got emotional on how spectacular and genuinely beautiful linear algebra is!

  • @md.salahuddinparvez6578
    @md.salahuddinparvez657811 ай бұрын

    The decomposition of a musical chord into the notes is such a beautiful touch !!! I am lucky I got to your channel.

  • @JunZhang-ralphjzhang
    @JunZhang-ralphjzhang11 ай бұрын

    The best explanation I've seen in 25 years, counting from my first exposure to matrices as a freshman

  • @max8110
    @max81103 ай бұрын

    This may not mean much from a stranger on the internet, but I don't know if I can convey with words how amazing and effective this video is. This is a masterpiece, and it stands far above the numerous math content I've seen (believe me, I've seen a lot). You have a real and rare skill for being extraordinarily concise and intuitive. Keep it up,

  • @nguyenquannnn8942
    @nguyenquannnn89425 ай бұрын

    Amazing, you just explained a concept in 15 minutes that my teacher failed to explain in 4 lectures. Keep being awesome!

  • @asatorftw
    @asatorftwАй бұрын

    This explanation was phenomenal. Great job!

  • @willwu7353
    @willwu7353 Жыл бұрын

    Damn this is so intuitive! Its easy to get lost in matrix multiplication but this was a superb reminder for me to just step back and just think of them as geometric transformations. Its actually kind of earth shattering. TY!!

  • @visualkernel

    @visualkernel

    Жыл бұрын

    Check out the SVD one , even cooler

  • @dimitrismylonas4159
    @dimitrismylonas4159 Жыл бұрын

    This video is beautifully animated and straight to the point. Thank you for illustrating decomposition in such an elegant way.

  • @karlrombauts4909
    @karlrombauts4909 Жыл бұрын

    It took some digging, but I am so glad that I found your videos. These are absolutely fantastic! I really hope that you get more subscribers and that you continue producing content. These videos have been exactly what I needed. Amazing work!

  • @charleskolozsvary8714
    @charleskolozsvary8714 Жыл бұрын

    This is absolutely awesome, surprised you don’t get as much recognition; really wonderful video

  • @kaansun8601
    @kaansun86012 ай бұрын

    This is literal gold, if you are reading this comment you hit a goldmine congratulations

  • @srikanthraghavan2092
    @srikanthraghavan2092 Жыл бұрын

    Really great vid!! So glad I was discovered this channel!!

  • @MaxxTosh
    @MaxxTosh Жыл бұрын

    So happy to stumble on these, you got a new subscriber today!

  • @jphicks1984
    @jphicks198411 ай бұрын

    Brilliant videos that really add to the understanding and intuition of these concepts. As others have said these videos deserve far higher views, and hopefully one day you will find time to make more!

  • @nenadilic9486
    @nenadilic9486 Жыл бұрын

    Amazing. I am stunned. Thank you.

  • @jamespeck1827
    @jamespeck1827 Жыл бұрын

    Excellent video! Would love to see more content like this :)

  • @amkhrjee
    @amkhrjee4 ай бұрын

    This video was infinitely awesome!

  • @MrWater2
    @MrWater2 Жыл бұрын

    Please keep doing this masterpieces! Thank you!

  • @karennn3973
    @karennn3973 Жыл бұрын

    really loved this video!!!! thank you so much!!! made the concept so much clearer!

  • @AnaPaladi
    @AnaPaladi Жыл бұрын

    It was nice to see the scalings and rotations done step-by-step, very helpful for a better understanding! ty

  • @Baaarain
    @Baaarain Жыл бұрын

    One of the best tutorial videos I have ever seen. Thanks

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w2 ай бұрын

    This is an amazing production. Thanks

  • @Scaryder92
    @Scaryder928 ай бұрын

    Thank you, this was beautiful and very informative! In my opnion, getting the intuition behind a concept is the best way to remember it and to apply it in a different context

  • @user-gp8jd3pw7z
    @user-gp8jd3pw7z5 ай бұрын

    Fantastic work, thank you for this

  • @soroushsobhkhiz9383
    @soroushsobhkhiz9383 Жыл бұрын

    Amazing videos. So underrated!!

  • @Es4la
    @Es4la Жыл бұрын

    This is amazing, thank you for all your high quality videos! Can't believe this has comparatively few views

  • @neilchen2570
    @neilchen2570 Жыл бұрын

    This is such an underrated video about the topic about matrix decomposition! I really like the approach that helps me visualize the meaning of the topic tremendously! Keep up the hard work!!!

  • @rushirajparmar9602
    @rushirajparmar960210 ай бұрын

    Amazing, mind blowing explanation!!!! We need more tutors like you! I wish they taught like this in high school.

  • @ruti_1494
    @ruti_1494 Жыл бұрын

    Thank you so much for your help!!!

  • @gustavopaiva4676
    @gustavopaiva46767 ай бұрын

    Really good video man, I was doing the exercises like a robot just applying steps in a specie of algorithm without knowing really the meaning of it. Now I can visualize this transformations and this decompositions in my head, thank you so much

  • @kakunmaor
    @kakunmaor9 ай бұрын

    THIS IS SICK! The best explanation I've ever seen on KZread

  • @galiyabanu
    @galiyabanu2 ай бұрын

    really supreme video! thanks a lot!

  • @ozachar
    @ozachar7 ай бұрын

    Most clear and illuminating

  • @yasseralg3928
    @yasseralg3928 Жыл бұрын

    Amazing explanation. Keep up this good work

  • @hjop010
    @hjop010 Жыл бұрын

    One of the best explanations in linear algebra I have ever seen. Subscribed. Keep up the good work.

  • @fnegnilr10
    @fnegnilr10 Жыл бұрын

    Neo would be proud of these vids. Fantastic job!

  • @asatorftw
    @asatorftw23 күн бұрын

    Watched this video again, and oh boy its so good!

  • @cardinalblues7121
    @cardinalblues71218 ай бұрын

    these videos are amazing,Thank you for sharing this with us.

  • @Stefabro
    @Stefabro Жыл бұрын

    thank you sooo much for these videos. for some reason I remember/understand concepts so much easier when they have visual interpretations

  • @mychen5520
    @mychen5520 Жыл бұрын

    Great extension to 3b1b's Linear Algebra series, Thanks so much !!! it really help me build the intuition

  • @davidsousa511
    @davidsousa51111 ай бұрын

    I find this impressive, this concepts are really hard to understand but the order and the way they are explained made very much sense to me! Thank you!

  • @gohilramdevrajeshbhai5254
    @gohilramdevrajeshbhai5254 Жыл бұрын

    Wow! This whole series is so beautiful! First time I understood so many important things! Thanks a ton Sir. Lot of gratitude towards you for this way of knowledge!

  • @adaslesniak
    @adaslesniak2 ай бұрын

    Thank you for this video. Thank you very much. It's awesome. I want more of your videos.

  • @jim8730
    @jim873011 ай бұрын

    So good!!!! Especially your explanation of eigen stuff.

  • @user-cg2zp4oc8y
    @user-cg2zp4oc8yАй бұрын

    this is fantastic!

  • @coletivismo4635
    @coletivismo46356 ай бұрын

    Brilliant! I wish professors emphasized this intuitive understanding more often

  • @marcelolarrea4583
    @marcelolarrea4583 Жыл бұрын

    love this videos...they´re so helpful......thanks man.....keep doing it......by the way, the chords detail was pretty nice....

  • @Vjdkgaming
    @Vjdkgaming4 ай бұрын

    Thank you so much for this video it really helped me better understand the concept!

  • @klevisimeri607
    @klevisimeri6076 ай бұрын

    Beautiful!

  • @nitika9769
    @nitika97693 ай бұрын

    thank you so much for introducing me to this. You've made my life easier through your work.

  • @yudzu8820
    @yudzu88202 ай бұрын

    excellent videos. I am so glad, that I found it. Thank you for a lot of work that you've done to make these excellent visualizations. Also the structure is intuitive and logically ordered. Bravo!

  • @vedanshkakkar4415
    @vedanshkakkar44152 ай бұрын

    Thank you so much.

  • @marazak6390
    @marazak63904 ай бұрын

    Insane visualisations! Helped me in the understanding of diagonalisation of matrices immensely Thanks a lot!!

  • @meet13321
    @meet13321 Жыл бұрын

    Thanks for these kind of content, I feel by having these kind of content you are helping people to understand power of mathematics and help apply these concepts which otherwise need tedious study of mathematical formulas , which helps people like us to bridge the gap to understand other applied solutions from these basics. Keep it up , world is converging and future solutions can only be solved when more people understand the basics intuitively and apply to solve new problems of world

  • @marcodelellis5194
    @marcodelellis51946 ай бұрын

    Brilliant! 👏👏👏

  • @user-cn2wf2nr1c
    @user-cn2wf2nr1c6 ай бұрын

    The logic flow renders much more understanding than other 'visual course', particularly about the eigenvector!!!

  • @kevinbyrne4538
    @kevinbyrne4538Ай бұрын

    Very nice presentation. Like a great athlete, you make what you do seem effortless.

  • @user-bz5zq9bv4o
    @user-bz5zq9bv4o11 ай бұрын

    very helpful. thank you. never expect math can be so easy to understand.

  • @arz3nal
    @arz3nal Жыл бұрын

    This is great! I took a course in Operator Theory and for the life of me couldn't visualize the spectral theorem in any intuitive way. I wish I found this video months ago!

  • @rohithsudarshan6524
    @rohithsudarshan6524 Жыл бұрын

    extremely well done, keep this up because college students with bad linalg professors truly appreciate the content.

  • @arkaroy8172
    @arkaroy81725 күн бұрын

    love from India, 3blue1brown and you guys really made algebra beautiful; again.

  • @crispml
    @crispml Жыл бұрын

    brilliant!!

  • @ryan_chew97
    @ryan_chew97 Жыл бұрын

    Holy crap, the Manim animations are incredible. I want to use Manim for my own channel for unrelated to math topics, and I am going to take inspiration from your style. It's probably the best I've seen aside from 3B1b.

  • @moritzh409
    @moritzh409 Жыл бұрын

    Dude I think this might be my first comment on youtube, but you deserve it haha. This series got me understanding matrices at a level even deeper than youtube-linalg's godfather 3blue1brown:) You ROCK! and dope logo you got for your channel! keep it up, I'll be there;)

  • @visheshgoyal5903
    @visheshgoyal59039 ай бұрын

    Video is transformative

  • @Henk-ms5ml
    @Henk-ms5mlАй бұрын

    Very nice, thank you very much:)

  • @chhabiacharya307
    @chhabiacharya3079 күн бұрын

    Thank you so much sir :)

  • @aezazi
    @aezazi Жыл бұрын

    Brilliant!

  • @andywang4189
    @andywang41896 ай бұрын

    Keep up great work man, I hope you can release more😢

  • @franciscorosetavazmonteiro1227
    @franciscorosetavazmonteiro1227 Жыл бұрын

    Yo this vid might of just saved for my finals thx düd

  • @tejasarya5312
    @tejasarya53127 ай бұрын

    Respect for you

  • @beckhamwilson2112
    @beckhamwilson2112 Жыл бұрын

    Great video

  • @CamEron-nj5qy
    @CamEron-nj5qy10 ай бұрын

    The guitar chord analogy was a nice touch

  • @duopleis
    @duopleis3 ай бұрын

    sublime

  • @zenicv
    @zenicv Жыл бұрын

    A pretty much under-appreciated course on LA

  • @Alpasonic
    @Alpasonic6 ай бұрын

    Very clear transparent video. It has also powerful mesmerizing effect. Calming satisfying Yoga-effect😅

  • @gerardocastaneda2204
    @gerardocastaneda2204 Жыл бұрын

    Excellent

  • @ChillyFries444
    @ChillyFries444 Жыл бұрын

    3b1b should shout this out man. Legend

  • @simonekockelkorn1235
    @simonekockelkorn12352 жыл бұрын

    Thank you very much!!! Hope you will find the time to make more video's:) You helped me a lot!:)

  • @visualkernel

    @visualkernel

    2 жыл бұрын

    It is interesting how I make this kind of video while expecting to be seen by no one. But youtube recommendation algorithm just does interesting things, leading people to the edge of the internet. And I am very glad if it could have offered an alternative perspective on how we view matrix decomposition. SVD coming out soon, that will be a good one.

  • @omridrori3286

    @omridrori3286

    2 жыл бұрын

    @@visualkernel Why expecting to see by no one ? I personally really like math videos and these are really great and definitely give good fight for 3blue1brown

  • @visualkernel

    @visualkernel

    2 жыл бұрын

    @@omridrori3286 Well, this video is currently not advertised, and finding a video like this is pretty challenging. (I actually tried to KZread search "Visualize Spectral Decomposition" explicitly, and my video does not even come out ). So I think it's very interesting how you landed on this piece of recommendation. And about 3b1b ... I think everyone who makes math video can only asymptotically approach the half of what he is. Thank you Omri, for your words of encouragement.

  • @omridrori3286

    @omridrori3286

    2 жыл бұрын

    @@visualkernel When i really wait for that every day i check please i really want to know svd

  • @kevinj7192
    @kevinj719210 ай бұрын

    I love these videos! I've watched 3Blue1Brown linear algebra videos. They are good but more conceptual math. These videos show how to implement linear algebra to computer graphics. I'm lucky to find it when I search svg

  • @ivarholmlund4962
    @ivarholmlund49624 ай бұрын

    Beautiful video, i was amazed about the quality and how good the explanations and vizualisations were! I dont see the chapter 1 part anywhere, is there only supposed to be the chapter 2?

  • @Ocara31
    @Ocara3127 күн бұрын

    Please, continue this series. Make about PCA !!!

  • @TheKrasTel
    @TheKrasTel Жыл бұрын

    Bro just keep making these vidoes and the views will eventually come, it is literally inevitable!

  • @billylee5624
    @billylee562417 күн бұрын

    This has gotten me to see the linear transformations of these "sandwich" estimators. I wonder how we can visualize econometric estimators like the basic OLS (X'X)^-1X'Y and it's covariance matrix (X'X)^-1(X'e')(eX)(X'X)^-1 and even longer matrix multiplication models.

  • @klaotische5701
    @klaotische57018 ай бұрын

    This actually complements some of the illustrations 3B1B didn't demonstrate.

  • @rohitv1310
    @rohitv131018 күн бұрын

    Thanks

  • @knector
    @knector Жыл бұрын

    Fantasic

  • @vinamarora7049
    @vinamarora70499 ай бұрын

    Around 4:00, the parallels between decomposing a matrix into simpler operations and decomposing a chord into its notes.. 🤯

  • @visualkernel

    @visualkernel

    9 ай бұрын

    Is this the Legendary Vinam Arora himself ?

  • @vinamarora7049

    @vinamarora7049

    9 ай бұрын

    @@visualkernel Ye buddy absolutely loved the video!

  • @anishmanandhar1203
    @anishmanandhar1203 Жыл бұрын

    Nice video mate just wanted to know how did you get the conceptual knowledge

  • @michaelooviera2123
    @michaelooviera21235 ай бұрын

    Great

  • @danielschreck9083
    @danielschreck9083 Жыл бұрын

    Amazing video, fantastic job. Small mistake - at 14:50, the labels for Q and L are incorrectly swapped - L is labeled as the eigenvector matrix and Q is labeled as the eigenvalue matrix, but the reverse is correct.

  • @stayinthepursuit8427

    @stayinthepursuit8427

    Жыл бұрын

    yes . Eigenvalues scale. Eigenvectors rotate.

  • @silkyfirst3097
    @silkyfirst30979 ай бұрын

    also wouldnt the eigen basis rotate the standard plane onto its transformation?

  • @sammyapsel1443
    @sammyapsel14435 ай бұрын

    Thx for the video! Couple of questions: 1. Does the SD(spectral decomposition) method, work only for full rank symmetric matrices? What are in general the conditions for the SD to work? 2. Would this work also for complex-valued symmetric matrices?

  • @Lonewolf-xv1bl

    @Lonewolf-xv1bl

    5 ай бұрын

    2. Yes. Complex valued symmetric matrix is called Hermitian matrix. You can perform similarity transformation with the help unitary matrix. Which are complex analogue of orthogonal matrix. Symmetric matrix S => Hermitian matrix H Orthogonal matrix O => Unitary matrix U You have O'SO similar for complex case You get (U*)'HU Here * represents complex conjugation and ' represents trasponse. There is single notation to represent it called dagger. It is not available in my keyboard so I broke it down. You have to take complex conjugation and then transport it.

  • @tonywang7933
    @tonywang79338 ай бұрын

    2:46 Q^T = Q^(-1) this is only true if Q is Orthonormal, but for the second and the third column of Q from the left, their magnitude exceed 1, I don't see how this still holds. Can you explain?