'How neural networks learn' - Part I: Feature Visualization

Interpreting what neural networks are doing is a tricky problem.
In this video I dive into the approach of feature visualisation.
From simple neuron excitation to the Deep Visualisation Toolbox and the Google DeepDream project, let's open up the black box!
Links:
Distill.pub post on Feature Visualisation: distill.pub/2017/feature-visu...
Sander Dieleman post on music recommendation: benanne.github.io/2014/08/05/s...
Blogpost on Deep Feature visualisation: yosinski.com/deepvis
Github link to DeepVis Toolbox: github.com/yosinski/deep-visu...
Paper by Zeiler & Fergus: arxiv.org/abs/1311.2901
If you want to support this channel, here is my patreon link:
/ arxivinsights --- You are amazing!! ;)
If you have questions you would like to discuss with me personally, you can book a 1-on-1 video call through Pensight: pensight.com/x/xander-steenbr...

Пікірлер: 115

  • @LanTheWarder
    @LanTheWarder5 жыл бұрын

    Going through interesting topics with a direct link to research. You're truly doing amazing work.

  • @EngNoRa
    @EngNoRa3 жыл бұрын

    I watched this video when I wanted to fall asleep, to satisfy my conscience that I had done something in my assignment , and also hearing these subjects makes me fall asleep quickly, but your way of presenting the information was beautiful and not boring, so I could not sleep but became more active to complete my assignment ! Thank you & keep going ⚡️

  • @MsFearco
    @MsFearco3 жыл бұрын

    Dude your content is amazing. So is Your way of talking and explaining... just amazing

  • @HeduAI
    @HeduAI5 жыл бұрын

    Amazing videos! You have an awesome art of squeezing advanced concepts into a short, simple and interesting video!

  • @tarsmorel9898
    @tarsmorel98986 жыл бұрын

    Very nice video! Looking forward to the next parts. Love the dreamy images ^^

  • @geordonworley5618
    @geordonworley56186 жыл бұрын

    This is really high quality stuff. I really appreciate the work you put in here. Keep it up!

  • @ollieoniel
    @ollieoniel Жыл бұрын

    This guy is super clear compared to everything else I have watched so far.

  • @PrisonBreakBoy
    @PrisonBreakBoy6 жыл бұрын

    Really enjoying your videos, please keep it up!

  • @robertc6343
    @robertc63433 жыл бұрын

    Fantastic channel! Great idea with highlighting the latest arXiv articles. I’ve been looking for a channel like yours! Subscribed and can’t wait to go through your content. Thanks for doing it.

  • @MrFun23
    @MrFun235 жыл бұрын

    Damn, this video is sooooo good! I subscribed to this channel after two minutes into the video. Great job!

  • @PhilippGrafendorfer
    @PhilippGrafendorfer5 жыл бұрын

    oh man. this is wicked stuff! I really enjoy your style.

  • @gmmapchi7883
    @gmmapchi78833 жыл бұрын

    i wan to mention that, your videos are super awesome! thank you!

  • @akaPuppetmaster
    @akaPuppetmaster4 жыл бұрын

    You are doing such a great job! I wanna see more :)

  • @harisdaniyal3904
    @harisdaniyal39044 жыл бұрын

    Very informative, and summarized knowledge. keep it up bro.

  • @LaurentLaborde
    @LaurentLaborde2 жыл бұрын

    this is so cool that you're here to explain stuff. too many video are like "you copy this code, press play, boom, you built the 344th billion mnist image classifier, gg"

  • @joe_hoeller_chicago
    @joe_hoeller_chicago Жыл бұрын

    Your channel is top quality. Thank you.

  • @user-bh8xb2yy5d
    @user-bh8xb2yy5d7 ай бұрын

    THANK YOOOOOOOU I was reading that article you commented on and I couldn't understand for the life of me how they were generating those images, so tysm ;-;

  • @ramchandracheke
    @ramchandracheke3 жыл бұрын

    You are amazing! Please keep posting new content!

  • @infoman6500
    @infoman65005 ай бұрын

    Excellent educational video on artificial and deep neural network learning.

  • @joelcpontee
    @joelcpontee6 жыл бұрын

    Excellent video, good job!

  • @perkelele
    @perkelele4 жыл бұрын

    Great video! Cheers from Belgium,

  • @nitinkumarmittal4369
    @nitinkumarmittal43693 жыл бұрын

    Awesome explanation!!

  • @prub4146
    @prub41463 жыл бұрын

    Thank you for making these videos

  • @GiangNguyen-of4qf
    @GiangNguyen-of4qf4 жыл бұрын

    Really nice explanation :) Thank you

  • @ravishankar2180
    @ravishankar21806 жыл бұрын

    you are really awesome brother. love from INDIA.

  • @andyandrw
    @andyandrw5 жыл бұрын

    Really informative video, thanks :)

  • @francoisplessier9913
    @francoisplessier99134 жыл бұрын

    Quite dense, but vey well explained!

  • @cupofkoa
    @cupofkoa5 жыл бұрын

    Using gradient descent to generate an image to max a neuron is cool, I suppose the same can be done with audio also? It would be interesting to hear what a neuron 'sounds like'.

  • @cupofkoa

    @cupofkoa

    5 жыл бұрын

    I guess its the exact same process but you convert the generated spectrogram image into an audio file.

  • @williamkyburz
    @williamkyburz6 жыл бұрын

    great presentation ! Thanks.

  • @shunzhang7477
    @shunzhang74776 жыл бұрын

    Amazing video!

  • @Micha-uy9xd
    @Micha-uy9xd3 жыл бұрын

    Thank you! Good Explanation!

  • @maximgospodinko
    @maximgospodinko6 жыл бұрын

    Your videos are amazing! Thank you

  • @maximgospodinko

    @maximgospodinko

    6 жыл бұрын

    Can’t wait for part 2)

  • @abhiramirr8619
    @abhiramirr86193 жыл бұрын

    Amazing video👍🏼

  • @user-or7ji5hv8y
    @user-or7ji5hv8y5 жыл бұрын

    Great video!

  • @abcborgess
    @abcborgess6 жыл бұрын

    Great videos!

  • @Ankitkumar04
    @Ankitkumar046 жыл бұрын

    Nice video... explained pretty well..

  • @samaygandhi7182
    @samaygandhi71823 жыл бұрын

    This was just amazingggg

  • @muskaczjohnson5944
    @muskaczjohnson59442 жыл бұрын

    Really good content

  • @barath_
    @barath_4 жыл бұрын

    Quality of your videos are the best. Good things take time but if you could upload weekly. It would be great.

  • @MrAniket28
    @MrAniket286 жыл бұрын

    Awesome insights

  • @hrsight
    @hrsight2 жыл бұрын

    Great video

  • @StasKhoroshevsky
    @StasKhoroshevsky4 жыл бұрын

    Great overview! Although I'm not sure Zeiler and Fergus' work on feature visualization you've mentioned is actually training the deconvnet via backprob, I remembered that he mentioned that deconvnet is used as a probe to reconstruct image patches from the selected activation maps.

  • @rafaelrodrigues6320

    @rafaelrodrigues6320

    3 жыл бұрын

    I agree with you. In the original deconvolutional network's paper (ieeexplore.ieee.org/abstract/document/5539957) they do train deconvolutional layers to reconstruct images in order to perform unsupervised training, but in the paper mentioned in the video they use transposed versions of the convolutional layers' filters to investigate a trained CNN for image classification.

  • @astroganov
    @astroganov5 жыл бұрын

    Super thanks for amazing videos! And I'm really waiting for the Part III :) You channel is the only one in my subscription list with the Bell turned ON :)

  • @mahmudinuwa3896
    @mahmudinuwa38963 жыл бұрын

    Thanks a lot, dude.

  • @gauthamsanthosh9658
    @gauthamsanthosh96586 жыл бұрын

    nice, i hope you make more videos. Good luck

  • @EdViaja
    @EdViaja6 жыл бұрын

    Excellent videos. I was wondering how can you evaluate and measure the layers inside, I've heard about these visualization methods so far. Thank you so much.

  • @autnuncautnumquam
    @autnuncautnumquam4 жыл бұрын

    Super cool!

  • @ViewsfromVick
    @ViewsfromVick2 ай бұрын

    Bro! you were soo ahead of your time! Like Scooby Doo

  • @ultrasgreen1349
    @ultrasgreen1349 Жыл бұрын

    very nice video

  • @make848
    @make8485 жыл бұрын

    This Thing can be used in Modern Art for sure. :)

  • @Tuberex

    @Tuberex

    4 жыл бұрын

    thisartworkdoesnotexist.com

  • @joliver1981
    @joliver19815 жыл бұрын

    Bravo!

  • @mireusted499
    @mireusted4995 жыл бұрын

    OMG feature visualisation LSD!

  • @nands4410
    @nands44106 жыл бұрын

    I was here when this channel had 200 subscribers!

  • @Ryutsashi

    @Ryutsashi

    6 жыл бұрын

    I wasn't

  • @PhilippGrafendorfer

    @PhilippGrafendorfer

    5 жыл бұрын

    me neither

  • @zongyiliu7
    @zongyiliu76 жыл бұрын

    Nice video, carry up! :}

  • @bryancc2012
    @bryancc20126 жыл бұрын

    Hi Dear Arxiv, very good video! subscribed. any resource regarding how to look into a RNN (bi-GRU) to visualize the feature?

  • @lywang5304
    @lywang53043 жыл бұрын

    Best AI channel EVER

  • @ragha1988
    @ragha19886 жыл бұрын

    Here is a project that i created to focus on visualization. Hope someone finds it useful. Can be applied to images, audio, text or anything else: github.com/raghakot/keras-vis

  • @Oliver0909
    @Oliver09093 жыл бұрын

    A trip to Bulgaria song :) Greetings from BG :)

  • @negatopoji7
    @negatopoji76 ай бұрын

    The term "activation" in the context of neural networks generally refers to the output of a neuron, regardless of whether the network is recognizing a specific pattern. The activation is indeed a numerical value that represents the result of applying the neuron's activation function to the weighted sum of its inputs. Just posting here what ChatGPT told me, because the definition of "activation" in this video confused me

  • @ericfeuilleaubois40
    @ericfeuilleaubois406 жыл бұрын

    Damn great video! Carry on ! This subject is so fundamental in Artificial Neural Networks : what the h*** do they learn ? ;)

  • @RoxanaNoe
    @RoxanaNoe5 жыл бұрын

    Great series of videos. The part 3 has been released??

  • @ArxivInsights

    @ArxivInsights

    5 жыл бұрын

    Roxana Noelia Not yet, but I'm working on it! Hopefully somewhere next month :)

  • @RoxanaNoe

    @RoxanaNoe

    5 жыл бұрын

    Thank you so much for doing these videos. This particularly one is great.

  • @dlisetteb
    @dlisetteb3 жыл бұрын

    what motivated you to start this kind of videos? when and how you started? I love explaining what i know but: i am not as clear as you are, and i certainly do not have patience to learn all those editing tools

  • @abhalla
    @abhalla4 жыл бұрын

    I wish there were more videos.

  • @jakubczubak1659
    @jakubczubak16592 жыл бұрын

    Feature visualisation is what an acid trip looks like

  • @bernardfinucane2061
    @bernardfinucane20616 жыл бұрын

    I think deep visualization of games networks like checkers or go would be interesting.

  • @michaelsalam1475
    @michaelsalam14754 жыл бұрын

    At 4:20 you said the audio spectogram is converted to image. So how is it done? Like mapping those spectogram with image feature or those spectograms are somehow converted to an image.

  • @psijkopupa6853
    @psijkopupa68533 жыл бұрын

    woow peacock in a educational video !

  • @dr.mikeybee
    @dr.mikeybee6 жыл бұрын

    Is the deconvolution a selective autoencoder?

  • @jonsnow9246
    @jonsnow92463 жыл бұрын

    That tune is the bassi tune

  • @thevivekmathema
    @thevivekmathema4 жыл бұрын

    you are so cool...

  • @saminchowdhury7995
    @saminchowdhury79952 жыл бұрын

    When you say Neuron do you mean the filters of a convolutional neural network? Thanks for the video

  • @allenyu1456
    @allenyu14565 жыл бұрын

    How effective is this music recognition algorithm? Some www 2018 challenge showed the winners only got 60% accuracy - how can this be effective at such a low level?

  • @mahdiamrollahi8456
    @mahdiamrollahi8456 Жыл бұрын

    How visualizing works in playground tensorflow? What do they mean?

  • @vd.se.17
    @vd.se.174 жыл бұрын

    which software are you using for video editing? plz reply...

  • @sushil-bharati
    @sushil-bharati4 жыл бұрын

    @Arxiv Insight - Cold start problem will not be solved by using deep nets to extract musical features. You will still not know what songs to recommend given a new user.

  • @sushil-bharati

    @sushil-bharati

    4 жыл бұрын

    Also, there is a way to figure out if a neural net is looking at the sky or the ship. Black-out the sky and feed the ship - see the response!

  • @adoniskomplex91
    @adoniskomplex914 жыл бұрын

    Is there a way to visualize neural networks in general?

  • @Osama_Abbas
    @Osama_Abbas Жыл бұрын

    What if we try maximizing a certain class (e.g. dog) instead of a specific neuron?

  • @nayannimbokar6137
    @nayannimbokar61374 жыл бұрын

    how can I visualize the features in Matlab??

  • @primodernious
    @primodernious2 жыл бұрын

    the c64 neutral net code did what these advanced nettoworks do back in the 80s in a single matrix input output layer reconstructing but with letters. it could not handle to much data as the same problem with it was the same as the modern version. the network get confused so make it big enough kind of solves it but not really. there is to many copies of mostly the same data in the network. im sure if such a basic linear function generated network like the 80s if big enough could feed a entire page of random letters and still make it reconstruct each trained letter correctly from random. think if you could do that with apples and bananas. im not sure if that would work but think in theory it chould. there is no reason why the network chould store the pattern of a banana or apple like a mess. i imagine the network can be trained with random objects and still reconstruct individual objects without classification.

  • @wolfisraging
    @wolfisraging6 жыл бұрын

    With theory it is ok to explain, but in real world we need some code to implement it practically, so have some code, btw Ur videos are awesome

  • @Docendo1121discimus
    @Docendo1121discimus3 жыл бұрын

    Can neural network learn creat 3D enviroment from reading book specific chapter where author specificly is discribing that inviroment? Guys make this question viral!!!

  • @420_gunna
    @420_gunna6 жыл бұрын

    When's part 3 coming out?

  • @ArxivInsights

    @ArxivInsights

    6 жыл бұрын

    Oh man, I really wanna make part 3 but I'm currently working on two episodes on Reinforcement Learning first, I wish I could do more episodes/month but currently I'm just too busy to work on this more than 10 hours/week. I need to find a way to increase my video output rate though :)

  • @420_gunna

    @420_gunna

    6 жыл бұрын

    Is there any way we can help besides the Patreon? By the way, a fan of your contributions across mediums! ^_^ Really excited for the RL series -- I can't wait to be able to give back in the way you are once I've accumulated a bit of knowledge. How do you view this channel and its impact relative to any other work you're doing?

  • @user-qu2oz2ut2h
    @user-qu2oz2ut2h6 жыл бұрын

    overall very good, but pops are a bit too loud and baby crying sounds at 1:28 are awful

  • @wiiiiktor
    @wiiiiktor5 жыл бұрын

    Has Part III ever been created?

  • @ArxivInsights

    @ArxivInsights

    5 жыл бұрын

    Not yet, but I'm actually starting work on it right now. Should be finished in a couple of weeks!

  • @wiiiiktor

    @wiiiiktor

    5 жыл бұрын

    @@ArxivInsights OK, great :)

  • @wolfisraging
    @wolfisraging6 жыл бұрын

    But there should be some code

  • @Pr0Cre
    @Pr0Cre3 жыл бұрын

    why do those pictures look like an ayahuasca trip?

  • @wolfisraging
    @wolfisraging6 жыл бұрын

    Faaaar better than siraj

  • @SirajRaval

    @SirajRaval

    5 жыл бұрын

    noted

  • @notsoclearsky

    @notsoclearsky

    5 жыл бұрын

    @@SirajRaval lmao

  • @jinlaizhang312
    @jinlaizhang3124 жыл бұрын

    why you stop update new vedios ?

  • @AlexAcostaB
    @AlexAcostaB4 жыл бұрын

    Great content but unnecessarily long. You could say the same in half of the time. But really, that’s cool stuff 😎 congrats.

  • @SoimulX
    @SoimulX Жыл бұрын

    8:57 sus

  • @webgpu
    @webgpu Жыл бұрын

    test

  • @BuceGar
    @BuceGar5 жыл бұрын

    If Spotify is using a deep neural net, then why are it's recommendations still awful.........

  • @ArxivInsights

    @ArxivInsights

    5 жыл бұрын

    Make sure you give it feedback. Really take some time to rate the songs in your recommended weekly, and after some time it'll get better!

  • @dougpaterson4490
    @dougpaterson44903 жыл бұрын

    Either stop waving your arms around, or focus more on your face and less on your hands .. its very distracting

  • @WahranRai
    @WahranRai6 жыл бұрын

    Too much bla blaa blaaa blaaaaaaaaaaaaaaaaaaaaaaa...........................