Yoshua Bengio: Deep Learning | Lex Fridman Podcast #4

Ғылым және технология

Пікірлер: 96

  • @jaymn5318
    @jaymn53183 жыл бұрын

    Lex, You will be remembered in the history books for bringing these visionaries to talk about their work that ordinary folks can understand.

  • @kristian-io
    @kristian-io5 жыл бұрын

    Please DO continue with these series! Thank you :)

  • @TEETHclothing

    @TEETHclothing

    2 жыл бұрын

    It’s mad to see what’s he has done with the podcast. Shout out to lex

  • @JohnGFisher
    @JohnGFisher5 жыл бұрын

    Thanks for having him on Lex, love hearing from the guys on the cutting edge.

  • @TheNyatzAnger
    @TheNyatzAnger5 жыл бұрын

    YES! Yoshua Bengio. Thank you for this continued AGI series Lex!

  • @SY-me5rk
    @SY-me5rk5 жыл бұрын

    Love how you trimmed the video, not a second of wasted time! Thanks.

  • @deeliciousplum
    @deeliciousplum4 жыл бұрын

    Wonderful talk. I do agree with Yoshua Bengio's critique of the 2014 film Ex Machina. Thank you for sharing this.

  • @marloncajamarca2793
    @marloncajamarca27935 жыл бұрын

    Amazing Interview! Thank you Lex and keep this great work!

  • @tzjtjktzjtzjztjztj
    @tzjtjktzjtzjztjztj5 жыл бұрын

    Amazing questions for an amazing speaker. Thank you Lex!

  • @onuryes
    @onuryes5 жыл бұрын

    Thank you so much Lex. Great content as always.

  • @Danny-ej3js
    @Danny-ej3js5 жыл бұрын

    Thank you Lex and Mr. Bengio! So many exciting points in there. I enjoyed the critique of Ex Machina (really liked the movie, but had similar problems with it).

  • @franktfrisby
    @franktfrisby3 жыл бұрын

    There is certainly a priori that helps build complex systems. Thanks Yoshua for this.

  • @omaewayowaiii
    @omaewayowaiii3 жыл бұрын

    Such a pleasure to watch those podcasts, Joshua Bengio just came after Francois Chollet. Keep going and Greets from Russia ;)

  • @mmanuel6874
    @mmanuel68745 жыл бұрын

    This guy looks chill AF

  • @logicboard7746
    @logicboard77462 жыл бұрын

    Gem of an interview...just saw in bits and pieces

  • @daisukemajima8257
    @daisukemajima82575 жыл бұрын

    I like this series. Please continue your cool way.

  • @caterinadelgalles8783
    @caterinadelgalles87832 жыл бұрын

    I looked uo some things I didn't understand and they are all computing terms, so, not my area of work! Such a great chat!

  • @caterinadelgalles8783
    @caterinadelgalles87832 жыл бұрын

    I'll have to listen to this again and look some stuff up!

  • @bayesianlee6447
    @bayesianlee64475 жыл бұрын

    Thanks for Lex always for having those great conversations and great lectures. If u r too busy Imma recommend u to watch 40:00 for two mins at least to get insights of how deep learning will go.

  • @minoxidil4662

    @minoxidil4662

    3 жыл бұрын

    if you're too busy just watch it later

  • @woodywiest
    @woodywiest5 жыл бұрын

    Great discussion, thank you Yoshua and Lex. A question about infants vs. machine learning: If we view the world as we see it, a continual, light-speed fast, changing pice of data, would it be safe to say that the infant uses huge datasets as well?

  • @danieljdick
    @danieljdick5 жыл бұрын

    This is awesome, Lex.

  • @kunjpatel1703
    @kunjpatel17035 жыл бұрын

    Great.! Just when a transformation in currently adopted system is needed.

  • @30803080308030803081
    @30803080308030803081 Жыл бұрын

    I would like to see you interview Yoshua for a second time.

  • @CatsInHats-S.CrouchingTiger
    @CatsInHats-S.CrouchingTiger4 жыл бұрын

    💕36:54- 37:34 💎 Excellent last question Lex!

  • @sherryhp10
    @sherryhp104 жыл бұрын

    What an amazing interview ! I need to Understand Gans

  • @ProfessionalTycoons
    @ProfessionalTycoons5 жыл бұрын

    my favorite researcher

  • @KulvinderSingh-pm7cr
    @KulvinderSingh-pm7cr5 жыл бұрын

    What you people think of using AR for supervised/reinforcement learning? Will it be our next step for learning sophisticated tasks?

  • @fataakstudio8501
    @fataakstudio85013 жыл бұрын

    Your topics are pretty interesting!

  • @Wolfmoss1
    @Wolfmoss14 жыл бұрын

    25:43 That moment was kind of ominous!.... ^_^

  • @johnroach7607

    @johnroach7607

    3 жыл бұрын

    "You Shouldn't Trust Him" - Ava

  • @jaiprakashbagotia4391
    @jaiprakashbagotia43915 жыл бұрын

    Our pleasure too.

  • @darianharrison4836
    @darianharrison48364 жыл бұрын

    To my likes, Bengio is amongst the top 3 ML scientists in the world.

  • @gs-nq6mw
    @gs-nq6mw4 жыл бұрын

    The youtube automatic caption is almost perfect,and that's super crazy.One or two years ago those captions were completely nonsense and now they were perfect

  • @kikirizki4318
    @kikirizki43184 жыл бұрын

    Where is the table of contents?

  • @alekseysoldatenkov5675
    @alekseysoldatenkov56755 жыл бұрын

    Great talk! Some feedback on the format: An unedited version might be better, the topics can get quite theoretical at times and when they do, it can take some time for the points to really set in. So the pauses can help with that. But I also don't mind re-watching. 😁

  • @Aman13579
    @Aman135793 жыл бұрын

    Yoshua is filtering the hype around AI & DL and speaking frankly. He has been a front-runner in DL for a long time and still is not carried away by it.

  • @suew303
    @suew3037 ай бұрын

    Every science progress is based on collective works of large group, beautifully said. Not only science, but almost everything, from poem, literature, even to every progress in our daily life. Individual who has name under each breakthrough is largely synthesizer of collective intelligence. ❤❤❤language, internet, and all technologies make it possible and easy.

  • @philippelaferriere2661
    @philippelaferriere26614 жыл бұрын

    25:41 The concensus is that breakthroughs in AI by private companies will (most likely) never be "bottled" and go undiscovered by the general research community. However, isn't Boston Dynamics in robotics a perfect example of exactly this?

  • @alexharvey9721
    @alexharvey97213 жыл бұрын

    Maybe it's on the original podcast, but it might have also been nice to have discussed ethics a bit. As in, how do we decide when/if there are ethical considerations. For example if we think there is a chance an AI has human level understanding of itself and the world, is it ok to be deleting, updating, modified ect (even if it doesn't have a specific value for it's own existence). Especially because it will be so hard to define whether an AI is self aware or simply mimicking. The general trend in the scientific community seems to be very post-fact, like we would need to define with certainty that it is self aware before we worry about ethics. But it's necessarily impossible to do that. Even if we can somehow make that definition (which we possibly can't with certainty), we would already be doing those things in order to create it. The criteria shouldn't be that we're sure it's self aware, but (as we would do for a potential person) be sure that it isn't. But that would also be self defeating, as it would mean we can't develop the AI to make the distinction in the first place. I'm not sure it will matter or be discussed seriously anyway as most people seem incapable of considering that any AI can be self aware, even if they consider their own brain and consciousness to be of physical origin. Which is self contradictory, but we're great at putting what we want before what we know!

  • @Dondlo46
    @Dondlo46 Жыл бұрын

    You really liked to use fixed camera only on first few podcasts

  • @dra.adrianadomingosromer4968
    @dra.adrianadomingosromer49684 жыл бұрын

    I know this comment comes a bit late, as a dr I believe that what is missing is a language between components to be used in ai, so the differents components within a system can Interact, you can even take these examples in celular behavior. We shoulf observe the micro before we can apply rules to the macro.

  • @jessicahardesty3358
    @jessicahardesty33585 жыл бұрын

    cc.Lex Fridman: cc.Yoshua Bengio: A strong case can be made to support your theory on sematics.

  • @ahmadchamseddine6891
    @ahmadchamseddine68915 жыл бұрын

    Why no one is discussing the limits of the applied mathematics we have in encoding higher cognitive learning?

  • 5 жыл бұрын

    Mathematics or physics?

  • @aigen-journey

    @aigen-journey

    5 жыл бұрын

    We have our natural brains as a point of reference and we can model every atom and every interaction with current mathematics/physics. It's just complex in terms of computational requirements. Why would artificial brains require new mathematics?

  • 5 жыл бұрын

    I thought that he might be meaning physical limitations. But mathematics has some limitations also. He will need to clarify.

  • @aigen-journey

    @aigen-journey

    5 жыл бұрын

    Maybe you're right. I just read too many "the universe is mysterious" or "humans don't understand X, so how can we understand Y" comments that bring nothing to the discussion and this sounded like "there's this obscure part of mathematics that I personally believe is key to everything and all those researchers don't get it". If I misunderstood the comment and took it the wrong way, I'm sorry.

  • @captaininsano8736

    @captaininsano8736

    5 жыл бұрын

    @@aigen-journey maybe he means we'll need entirely new maths to encode the human mind. Thats literally whats implied. Idk if thats true but its interesting. I wonder if anyone serious has hypothesized this

  • @NikolaiVarankine
    @NikolaiVarankine5 жыл бұрын

    Lex, thank you for the chance to listen to Yoshua. But where's your impression? Where's excitement?

  • @eaf888
    @eaf8882 жыл бұрын

    🔥🔥

  • @idrissjairi
    @idrissjairi6 ай бұрын

    It feels like he was talking about Transformer's architecture 😉

  • @bennokrojer8406
    @bennokrojer84063 жыл бұрын

    6:49 "Neither!" 😂

  • @podcastsubtitled333
    @podcastsubtitled333 Жыл бұрын

    Outline: 0:00 Introduction 3:42 Current state of deep learning 6:44 Architecture vs dataset 8:01 Learning through interaction 10:46 Our brain is big 12:40 Knowledge 24:01 Ex Machina 25:28 Bottle Ideas 27:54 Bias in Machine Learning 31:29 Teaching Machines 33:58 The Turing Test 37:48 Whats next 40:20 Gans

  • @deeplearningpartnership
    @deeplearningpartnership5 жыл бұрын

    Great interview, thanks Lex. Yoshua seemed a bit angry.

  • @rockapedra1130

    @rockapedra1130

    3 жыл бұрын

    Deep Learning Partnership yep, not angry per se, more like grumpy. Maybe had an annoying day, lol.

  • @y__h
    @y__h5 жыл бұрын

    Joshua is very impressive talker, I can't understand him in 1.5x speed.

  • @ausroy087

    @ausroy087

    5 жыл бұрын

    u missed the Y

  • @thunde7226
    @thunde72265 жыл бұрын

    wow............totally agree with the points of those movies....that one individual creates........and invents all things......no it doesn't happen like that.........Leon Musk has teams, and engineers that solve, and build more prototypes......Man can't be compare and idolize as God to create things..............................Great interview Lex......Thanks.............:) ................bye

  • @IFFranciscoME
    @IFFranciscoME Жыл бұрын

    24:30 and on how Hollywood pictures A.I. progress

  • @bornslippy9109
    @bornslippy91095 жыл бұрын

    @24:40 Tesla: Hold my coil

  • @EngIlya
    @EngIlya5 жыл бұрын

    Great interview! But I did not like all the thinking moments cut out. Makes it unnaturally fast, and takes away the time for me to think as well.

  • @seetsamolapo5600
    @seetsamolapo56002 ай бұрын

    Research - artificial neural networks are modelled on biological neural networks - the difference between biological neural networks and artificial neural networks - properties of BNNs and how they occur - mechanisms

  • @darylallen2485
    @darylallen24854 ай бұрын

    Wow, not even 200,000 views in 5 years!

  • @rachidakebichi8733
    @rachidakebichi8733 Жыл бұрын

    Premonition from Yoshua B.: need a system with human in the loop for training, this is exactly what was done for ChatGPT.

  • @suzakico
    @suzakico5 жыл бұрын

    One key missing linkage in AI, the mysterious point, seems to be the biological consideration. If our brain is an organ added/expanded later to explore our live better, the objective function of AI should have such consideration to orchestrate the whole even though certain suboptimization may take place as we may move our attention from one to the next. Sleep/dream or meditative process may represent the way to seek for better optimization by coming up with deeper insight for each of us to live better. The interplay of conscious and unconscious (while we may seek balancing various sub-optimized objective functions) is a way for us to respond to various stimuli to find a way to be alive - and to live better. My sense is: given that we live in the world of impermanence, we are made (i.e., programmed) to feel happy when we are in line to accomplish such a task. -> If so, my question to AI scientist is: how do you bridge the gap?

  • @suzakico

    @suzakico

    5 жыл бұрын

    From my exposure to Zen, meditation, etc., I see being aware of "conscious of unconscious" is the way to discover insight/wisdom. Here, commonly used expression, Sila (right conduct/habit/edge) -> samadhi (reach out to unconscious mind and body are one - deep learning) -> panna/prajna/WISDOM (insight - know what is going on and how to act) is how the process may work - following the principle of Law/ Nature's way. Or, Thy will be done. I am very much interested in witnessing how AI may merge with such an age-old practice.

  • @pazuzil
    @pazuzil4 жыл бұрын

    this is the guy who starts Skynet

  • @bassplayer807

    @bassplayer807

    4 жыл бұрын

    Or LEGION

  • @kislaykunal8921
    @kislaykunal89215 жыл бұрын

    25:50 google duplex

  • @hoyinchan343
    @hoyinchan3435 жыл бұрын

    Human intelligence come from everyday natural learning.

  • @MartinLichtblau
    @MartinLichtblau5 жыл бұрын

    Curiosity is a reward function (especially for newborns).

  • @TheHellogs4444

    @TheHellogs4444

    5 жыл бұрын

    Less a reward function, more like that's the explorative policy that they use (and update to satisfy more curiousity)

  • @alvinphantomhive3794

    @alvinphantomhive3794

    3 жыл бұрын

    ​@@TheHellogs4444 and parent is more likely to play a role as an external critic assignment that attempt to reduce the explorative probability and using their prior knowledge to just straightly label the unexplored policy

  • @jacobadamczyk3353

    @jacobadamczyk3353

    2 жыл бұрын

    @@TheHellogs4444 MaxEnt RL is the popular way to formalize this idea 💡

  • @TheHellogs4444

    @TheHellogs4444

    2 жыл бұрын

    @@jacobadamczyk3353 YES! I loved entropy based models and maxEnt RL in particular is amazing. I think maxEnt RL with better models and dynamic updates will probably lead us close enough to AGI that there wont be any jobs any more.

  • @jacobadamczyk3353

    @jacobadamczyk3353

    2 жыл бұрын

    @@TheHellogs4444 Have any specific ideas on new approaches? Or do you see any interesting new areas?

  • @pardoharsimanjuntak1483
    @pardoharsimanjuntak14835 жыл бұрын

    I hope that there will be intelligent beings from other planets who come to help us accelerate computer technology on earth, or humans who come from a future that brings technology from the future.

  • @NisseOhlsen

    @NisseOhlsen

    5 жыл бұрын

    Pardohar Simanjuntak I hope we will soon assume responsibility and threat Earth better.

  • @pardoharsimanjuntak1483

    @pardoharsimanjuntak1483

    5 жыл бұрын

    are you worthy to be saved.

  • @MartinLichtblau
    @MartinLichtblau5 жыл бұрын

    Follow your intuition and update if new evidence appears.

  • @MartinLichtblau
    @MartinLichtblau5 жыл бұрын

    Peculiarities and phenomena of human psychology == breadcrumbs to underlying structures We already have to much common knowledge - we just have to use it.

  • @user-cn4qb7nr2m
    @user-cn4qb7nr2m4 жыл бұрын

    Oh, when vulcanians try to emulate emotions... so cute

  • @windowpane1000
    @windowpane10005 жыл бұрын

    What if the lights went off because robots from the future are warning us? haha

  • @SaveAsss
    @SaveAsss5 жыл бұрын

    How about a person without hands and legs? Have good inteligence.

  • @CharlesVanNoland

    @CharlesVanNoland

    5 жыл бұрын

    Sure, but they're still a human - the product of natural selection evolving the brains we all have over millennia alongside arms and legs. Simultaneously, a quadruple-amputee or quadriplegic has all of the collective awareness and history of humanity to derive understanding, skill, and know-how from - the four-limbed kind that developed it. Being able to develop that knowledge, understanding, and awareness for anyone to have at all required humans with limbs to explore and solve the questions that they had about existence and the nature of it.

  • @kimchi_taco
    @kimchi_taco4 жыл бұрын

    Disentangle representation in hierarchical manner.

  • @caterinadelgalles8783
    @caterinadelgalles87832 жыл бұрын

    Lex's Russian is limited. His statement about Russian poetry was a bit.....ok......but his father should have kept that Russian alive in him!

  • @mcole6121
    @mcole61214 жыл бұрын

    I hate how easily men dominate this field because of the wealth in AI

Келесі