Heroes of Deep Learning: Andrew Ng interviews Andrej Karpathy

Пікірлер: 109

  • @maganaluis92
    @maganaluis926 жыл бұрын

    Andrew Nj and Andrej in the same video, this will go down in history!

  • @selva279

    @selva279

    4 жыл бұрын

    It would have been complete if Chris olah also joined them

  • @jorjiang1

    @jorjiang1

    3 ай бұрын

    stop cheerleading and code yourself

  • @nickang6647
    @nickang66476 жыл бұрын

    Prof Andrew is a really humble person! Thanks for taking the time to interview and share this. 13:02 - Advice for people thinking about entering the field of AI, deep learning

  • @saikrishnaklu

    @saikrishnaklu

    6 жыл бұрын

    Thats an amazing reply #13:02

  • @aitarun
    @aitarun6 жыл бұрын

    I have to listen Andrej part at 0.75 speed. :)

  • @gianluke

    @gianluke

    6 жыл бұрын

    I've checked a couple of time the youtube settings because I thought the video was accelerated :|

  • @quietbydayYT

    @quietbydayYT

    6 жыл бұрын

    Yes, the sign of a brain limited by the bandwidth of speech. lol

  • @SaiFi0102

    @SaiFi0102

    6 жыл бұрын

    Haha, it sounds much better 0.75 :'D

  • @itttottti

    @itttottti

    6 жыл бұрын

    hahaha, show and gone

  • @pakigya

    @pakigya

    6 жыл бұрын

    Thank you. I was watching at 2x speed before lol

  • @curioussand1339
    @curioussand13396 жыл бұрын

    Andrej Karpathy talks in such a way that I briefly thought I had the clip running @ 1.25

  • @WhenIMetTheWorld
    @WhenIMetTheWorld6 жыл бұрын

    Andrew Ng is my hero .... He motivated me the first time from his lecture series on Machine learning

  • @HarshitMalik

    @HarshitMalik

    6 жыл бұрын

    Well said bro!

  • @ArunSharma-de7mk

    @ArunSharma-de7mk

    6 жыл бұрын

    Truth has been spoken :)

  • @anshikakhandelwal2633

    @anshikakhandelwal2633

    6 жыл бұрын

    Ayushman, if you've learnt the art, start transferring it.

  • @imdadood5705

    @imdadood5705

    3 жыл бұрын

    Are you still in this field?

  • @bellaggio1770
    @bellaggio17705 жыл бұрын

    Humbling to hear people who are way smarter than us

  • @blueborne4031
    @blueborne40314 жыл бұрын

    Both of these people are my heroes. I would not have gone into deep learning without them

  • @morebaie3412
    @morebaie34124 жыл бұрын

    What an amazing interview! Andrej Karpathy is making a great work intersecting NLP with computer vision, it's a huge move in the AI era.

  • @fabianmarin8514
    @fabianmarin851410 ай бұрын

    The two folks from which I've learned the most about AI. Thanks so much!

  • @mdougf
    @mdougf5 жыл бұрын

    Thanks for this interview, Andrew; you're the man. And hello to my fellow learners! Is anyone interested in starting a weekly machine learning research paper reading and discussion group with me?

  • @cupajoesir
    @cupajoesir6 жыл бұрын

    The energy present in this discussion is fantastic. Thanks for sharing.

  • @vladimirbosinceanu5778

    @vladimirbosinceanu5778

    2 жыл бұрын

    It's amazing how we can perceive honesty/passion and how we can resonate with it. Thank you Andrew and thank you Andrej!

  • @AnkitBindal97
    @AnkitBindal976 жыл бұрын

    DFS, BFS, Alpha-beta pruning....... Exactly! Even undergraduates are taught these things. It's nowhere near what is actually happening in machine learning.

  • @kssreesha
    @kssreesha3 жыл бұрын

    This has some of the best insights !!

  • @rajatrao5632
    @rajatrao56324 жыл бұрын

    Important statement Andrej made was " we truly understand the library/things that abstract away many low level complex things..when we once are in a position to write something from scract low level and then we will be comfortable to use the libraries who are doing the same and modify " truly a great statement

  • @shubharthaksangharsha6248
    @shubharthaksangharsha6248 Жыл бұрын

    2 legends in one frame

  • @vq8gef32
    @vq8gef322 ай бұрын

    He is a real hero, I am watching his lessons : Love + AI === Andrej

  • @dciug
    @dciug6 жыл бұрын

    until 1:40 YES! That is exactly how I felt during the AI class that I took. I really thought that those methods do not deserve to be named AI. NNs and Boltzmann Machines are what really got me started into this field. I can do this all day and not feel tired, and that's awesome.

  • @adityasoni121
    @adityasoni1216 жыл бұрын

    I wonder what will happen if Andrej would cite a story to a toddler... Great Lecturer!!(Really enjoyed CS231N) Thank you..

  • @guestimator121

    @guestimator121

    6 жыл бұрын

    +Aditya Soni "..Cooncretely, Hansel has put all the pebbles in his pocket in a way... well, you really don't need to know all of the details of how did he do it to understand the rest o the story, the important thing for you to understand was that he had pebbles in his pocket..."

  • @mynameisZhenyaArt_
    @mynameisZhenyaArt_6 жыл бұрын

    thanks for preserving knowledge :)

  • @jackxiao8140
    @jackxiao81403 күн бұрын

    Love the little laugh at 12:58

  • @BrutalStrike2
    @BrutalStrike2 Жыл бұрын

    Now Andrej made own mini course on his KZread

  • @sarahjamal86
    @sarahjamal865 жыл бұрын

    Well he is my hero as well ... because of him I could understand the concepts and implement them before moving to use tensorflow and pytorch. Thanks Karpathy, your contributions to the CS community are so valuable. :-)

  • @phillaysheo8

    @phillaysheo8

    Жыл бұрын

    Women who like ML are hot 🤩

  • @inilahsaltakadnak
    @inilahsaltakadnak6 жыл бұрын

    Very insightful. At 10:15 the split of AI is interesting

  • @preethamgali3023
    @preethamgali30233 жыл бұрын

    Exactly, implementing from scratch does help one to understand better.

  • @maciejbalawejder1819
    @maciejbalawejder18193 жыл бұрын

    10:57 - but that's exactly tesla's approach to self-driving, creating separate models and merge them together

  • @YULi-qf1wq
    @YULi-qf1wq6 жыл бұрын

    Andrej is less confident than he was in cs231 class but cuter for his humbleness in this interview without any direct gaze to camera :D

  • @bntagkas
    @bntagkas4 жыл бұрын

    i have to listen to this at 1.25 speed only instead of usualy 1.5 or 1.75, nice

  • @benitoteehankee3014
    @benitoteehankee30146 жыл бұрын

    "... not decomposing but having a single neural network, a complete dynamical system, that you're always working with -- a full agent. The question is: 'How do you actually create objectives such that when you optimize over the weights to make up that brain, you get intelligent behavior out?' " Really interesting. That sounds a lot like the goal of teaching human beings, too. How do you teach without decomposing knowledge into subjects and teach from a holistic point of view?

  • @stock99

    @stock99

    6 жыл бұрын

    Benito Teehankee this question is the best part of the entire interview to me. Good question is half of the answer. Digging into it.... Very interesting..

  • @6thHorseMan
    @6thHorseMan6 жыл бұрын

    Start out with what is under the hood and build your knowledge from there. To fully understand ML you can't just be a library user.

  • @5gururaj5
    @5gururaj56 жыл бұрын

    I turned it to 1.25x as usual, and I had to switch back to 1x 😄

  • @motiurrahman
    @motiurrahman6 жыл бұрын

    Such a cool interview - the mentor interviewing the mentee.

  • @myspacetimesaucegoog5632
    @myspacetimesaucegoog56326 жыл бұрын

    I'm super keen to hear how Andrei's ideas for an overall "just learn everything about everything" type AI progress. I kind of imagine a "baby" AI system following humans around watching imitating absorbing and learning - somehow., gradually growing up...

  • @ChandlerRandolph-yc5re
    @ChandlerRandolph-yc5re9 ай бұрын

    very informative!

  • @malikhamza9286
    @malikhamza92863 жыл бұрын

    This is the first video I haven't watched in 1.25 or 1.5x

  • @randywelt8210
    @randywelt82106 жыл бұрын

    Can please explain anyone ctc loss and beam search decoding in numpy? That is implemented in tensorflow, but it is really hard to understand what is going on.

  • @dgimop

    @dgimop

    6 жыл бұрын

    In case you have not yet figured this out: I skimmed over the CTC paper, cited by tensorflow, for a minute. Are you talking about how CTC works as a whole or only about how the cost/loss is calculated in the softmax (output) layer, as in how the loss function works for this classification algo? I can give some pointers on what I understood about the latter. My explanation might be either naive or complicated, depending on how deeply you understand ML. CTC calculates the cost of an error using the principles of maximum likelihood estimation (MLE). In particular, 'minimising it [the cost function] maximises the log likelihoods of the target labellings' - as the authors say. To label the output, it uses one extra unit in the softmax layer than the number of output labels, unlike traditional methods that use as many output units as there are labels to classify. The extra unit is reserved for observing a 'blank' or 'no label' class. If my understanding is correct, this gives the algorithm some breathing room to skip over labelling the data that is does not understand correctly and save it for later (?) rather than falsely classifying it as one of the labels because it was forced to do so. Couldn't get the time to learn about beam search decoding :)

  • @michaellidster1389
    @michaellidster13894 жыл бұрын

    Heroes hey

  • @MartinLichtblau
    @MartinLichtblau6 жыл бұрын

    Our biggest fallacy: if we model each human ability by hand we will have a AI. Same fallacy was committed before with feature modelling. Today we know better. Or at least we thought so..... unreflected we are!

  • @ehfo
    @ehfo6 жыл бұрын

    he talks so fast!

  • @relganz4663
    @relganz46636 жыл бұрын

    12:55 best part. Whatever his idea is, it's probably right. But why no question about Tesla? not even high level?

  • @phillaysheo8
    @phillaysheo8 Жыл бұрын

    "It's not rocket science or nuclear physics" 😀 "You just need to know linear algebra and calculus" 😔

  • @hasnainabbasdilawar8832
    @hasnainabbasdilawar88326 жыл бұрын

    This guy talks fast!

  • @israelabebe1297
    @israelabebe12976 жыл бұрын

    what course is he talking about?

  • @taylordelehanty8008

    @taylordelehanty8008

    6 жыл бұрын

    Israel Abebe they're talking about the Stanford course here cs231n.stanford.edu

  • @markhofstede
    @markhofstede6 жыл бұрын

    Would love to see him speak with Elon!

  • @godspeed133

    @godspeed133

    3 жыл бұрын

    He now works for Elon (maybe he had started by then and you knew(?))

  • @omeryalcn5797
    @omeryalcn57976 жыл бұрын

    Warning !! real time of video is 20.1333333333 :)

  • @KaiyuZheng
    @KaiyuZheng4 жыл бұрын

    I actually didn’t set the speed to 2

  • @abdAlmajedSaleh
    @abdAlmajedSaleh16 күн бұрын

    I didn't know it was dog network.

  • @-mwolf
    @-mwolf Жыл бұрын

    10:55

  • @realGBx64
    @realGBx645 жыл бұрын

    It is so weird for me when they emphasize the importance of knowing the basics. InEastern Europe we learned almost everything from bottom up. I had abstract maths before calculus, wrote algorithms on paper, calculated matrix determinants by hand, etc.

  • @BrianBull
    @BrianBull6 жыл бұрын

    Tesla AKnet

  • @dvm509
    @dvm5096 жыл бұрын

    when AI god speaks ...

  • @Jerry-yy1qy
    @Jerry-yy1qy4 жыл бұрын

    说话速度有点快

  • @user-wo5ie9hk1o
    @user-wo5ie9hk1o5 жыл бұрын

    А почему такое всратое качество в 2017-м году?

  • @rubixcom
    @rubixcom6 жыл бұрын

    hang on... but had he actually trained himself on that dataset, he would be performing better than ML

  • @dixingxu
    @dixingxu6 жыл бұрын

    human benchmark lol

  • @tianshiliao5372
    @tianshiliao53726 жыл бұрын

    Just not a big fan of udemy ML ads.. spent 20 hrs on it without learning the proper definition and math expression of cost function.. what a waste of time I have to say

  • @dgimop

    @dgimop

    6 жыл бұрын

    The course Andrew NG was talking about is in Coursera, not Udemy, if I understand your concern correctly. This is a brand new specialization. However, the best available Machine Learning course online, in my opinion, is Andrew NG's own course titled 'Machine Learning'. It's absolutely amazing, very detailed and free. It is probably the very first online ML course. I dropped out of a grad course at the university and spent that entire semester on this course. It eased me into my grad research.

  • @surfermx
    @surfermx2 жыл бұрын

    Mercedes-Benz is already level 3, while Tesla is just level 2, this weirdo seems has no noticed it yet

  • @Tom-ku8bu

    @Tom-ku8bu

    Жыл бұрын

    Mercedes is only level 3 on certain situations on the highway but Tesla is on the way to be highest level on any road and every situation. The computer of the Tesla's are probably more powerful than of Mercedes. But why do you mention it on a video that is 5 years old? At that time Mercedes was no where with self driving and in Tesla's it was already an early not so good version available. Now fsd beta gets every update better and is already pretty amazing how it handles heavy traffic in cities which Mercedes can't.

  • @CorporateDrone
    @CorporateDrone2 жыл бұрын

    It isn’t obvious to me that Andrej is not a genius

  • @samahirrao
    @samahirrao6 жыл бұрын

    Andrew Ng does not feel like a good person.. Kind of started hating him. But his research is no doubt great.

  • @Samir_Zope

    @Samir_Zope

    6 жыл бұрын

    Why is he not good person?

  • @reetigarg7398

    @reetigarg7398

    6 жыл бұрын

    R1nz0R I think it's largely because of the way he interacts with others. But I think you're mistaken there, he might come across as not a good guy when he actually is.

  • @Samir_Zope

    @Samir_Zope

    6 жыл бұрын

    Reeti Garg imo he actually seems like a kind person but ok xD

  • @myspacetimesaucegoog5632

    @myspacetimesaucegoog5632

    6 жыл бұрын

    Gosh I thought Andrew seems an extremely good person, watching him in this video.