Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat

Ғылым және технология

Here is my episode with Demis Hassabis, CEO of Google DeepMind
We discuss:
- Why scaling is an artform
- Adding search, planning, & AlphaZero type training atop LLMs
- Making sure rogue nations can't steal weights
- The right way to align superhuman AIs and do an intelligence explosion
Transcript: www.dwarkeshpatel.com/p/demis...
Apple Podcasts: podcasts.apple.com/us/podcast...
Spotify: open.spotify.com/episode/6SWb...
Follow me on Twitter: / dwarkesh_sp
Timestamps
0:00:00 Nature of intelligence
0:05:56 RL atop LLMs
0:16:31 Scaling and alignment
0:24:13 Timelines and intelligence explosion
0:28:42 Gemini training
0:35:30 Governance of superhuman AIs
0:40:42 Safety, open source, and security of weights
0:47:00 Multimodal and further progress
0:54:18 Inside Google DeepMind

Пікірлер: 363

  • @QuantPhilosopher89
    @QuantPhilosopher89Ай бұрын

    It's really awesome to finally have a podcast host who is capable of asking the right questions and of of having access to the key people.

  • @CyberKyle

    @CyberKyle

    Ай бұрын

    I agree! I would check out the Hard Fork podcast episode with Demis too, I was surprised at the level of discussion for the non-technical hosts, they asked great questions that teased a lot of exciting stuff from Demis.

  • @MrMikkyn

    @MrMikkyn

    Ай бұрын

    I agree. This is one of the better podcasts between a host and an AI expert

  • @attilakun7850

    @attilakun7850

    Ай бұрын

    So Demis, do you believe in aliens 😂

  • @sup3a

    @sup3a

    Ай бұрын

    Agreed 100%. Often feels like a better Lex (and I say this as a long-time fan of Lex)

  • @JakeWitmer

    @JakeWitmer

    Ай бұрын

    Better than most.

  • @DwarkeshPatel
    @DwarkeshPatelАй бұрын

    Hope you guys enjoy this interview with Demis. If you do, please share it! Helps a lot :). Thanks for watching 🙏

  • @zandrrlife

    @zandrrlife

    Ай бұрын

    So refreshing to have a true technical interviewer. You ask the REAL questions. Glad I found your channel.

  • @theWACKIIRAQI

    @theWACKIIRAQI

    Ай бұрын

    All your interviews are a breeze. Very informative and easy to follow through all topics touched. Thank you.

  • @ChuckNorris-lf6vo

    @ChuckNorris-lf6vo

    Ай бұрын

    Wow this guest is very talkative like bla bla bla bla bla what a machine what a machinegun of words.

  • @Rareme530

    @Rareme530

    Ай бұрын

    Subscribed. Spot on.

  • @ivoryas1696

    @ivoryas1696

    Ай бұрын

    @DwarkeshPatel Almost wish it was _longer, but nice job anyway!

  • @byrnemeister2008
    @byrnemeister2008Ай бұрын

    This guy is just about the best interviewer of tech folks. Excellent questions. Some thought has been applied rather than sticking to what everyone else is asking.

  • @MrMikkyn

    @MrMikkyn

    Ай бұрын

    I agree. I find the other podcasts tend to ask computer generated sounding questions.

  • @hugopennmir

    @hugopennmir

    Ай бұрын

    mmm Lex ?

  • @moviesfan5513

    @moviesfan5513

    Ай бұрын

    ​@@MrMikkynDwarkesh is computer science graduate so infinitely more technically competent than an average journalist.

  • @user-tl5ok1ff6k

    @user-tl5ok1ff6k

    Ай бұрын

    @@hugopennmir Lex is kind of a naive child, I don't enjoy his interviewing style its incredibly biased and he hardly pushes back at all letting gremlins like Tucker Carlson run roughshod over him with their bevy of lies. He's too idealistic and his questions and subsequent conversaion are too unfocused on the tech.

  • @egor.okhterov

    @egor.okhterov

    Ай бұрын

    Sure, sure, sure, yeah, yeah, yeah

  • @zaaath
    @zaaathАй бұрын

    This is a great conversation! It would've been even better if Dwarkesh's speech were clearer. I think Dwarkesh optimizes for speed which at times makes it inaudible. In any case, I'm looking forward to more guests like Demis.

  • @HuxleyCrimson

    @HuxleyCrimson

    Ай бұрын

    Totally agree. I even suspected that his interventions were sped up

  • @microbe_rz31

    @microbe_rz31

    19 күн бұрын

    Do you have Dunkin' Donuts coffee in Britain? 210 mg of caffeine vs Starbucks 80 mg.

  • @akhil090579
    @akhil090579Ай бұрын

    Its so great you do these interviews and ask intelligent questions that require non trivial answers

  • @xsuploader

    @xsuploader

    Ай бұрын

    yh. Most interviewers ask the same dumb generic questions. But not dwarkesh

  • @hardheadjarhead
    @hardheadjarheadАй бұрын

    I had no idea what they were talking about. But the interviewer clearly is the fastest speaking human being on the planet.

  • @godspeed133

    @godspeed133

    Ай бұрын

    clearly a next level SOTA technical interviewing specialised LLM with a photorealistic animated avatar generated on the fly.

  • @TedToal_TedToal

    @TedToal_TedToal

    Ай бұрын

    If you speed up the interviewer, it is completely unintelligible.

  • @AtomicSlugg
    @AtomicSluggАй бұрын

    genuinely the best interviewer when it comes to tech/AI, excited to watch this, thank you!

  • @StrandedKnight84
    @StrandedKnight84Ай бұрын

    You ask the best questions, Dwarkesh! Speaking from the perspective of someone who has worked in the field of AI for several years, I'm impressed by how well read you are on technical concepts.

  • @forthehomies7043
    @forthehomies7043Ай бұрын

    Huge. Looking forward to watching this after classes. Thanks.

  • @wdwuccnxcnh7022
    @wdwuccnxcnh7022Ай бұрын

    So excited for this. You're really an amazing interviewer. Ty ❤

  • @user-tl5ok1ff6k
    @user-tl5ok1ff6kАй бұрын

    I listened to this at .95 speed. The change might seem insignificant, but it was actually incredibly helpful in slowing down the high density stream of information just enough to be able to catch every word. I highly reccomend anyone else struggling to keep up with the question-answer pace to do the same.

  • @erang4437

    @erang4437

    Ай бұрын

    That applies to the interviewer, Demis speaks just at the right speed.

  • @dovekie3437

    @dovekie3437

    Ай бұрын

    .95 speed is probably closer to what it was recorded at. The normal version clearly has been sped up.

  • @NoXic88

    @NoXic88

    Ай бұрын

    It's helpful turning the closed captions (subtitles) on too :)

  • @HuxleyCrimson

    @HuxleyCrimson

    Ай бұрын

    The intervewer interventions sound to be sped up honestly

  • @matthewburson2908

    @matthewburson2908

    Ай бұрын

    @@erang4437 Yeah. Kinda makes this whole thing garbage lol.

  • @BrianMosleyUK
    @BrianMosleyUKАй бұрын

    Great episode Dwarkesh and some insightful questions throughout. Well done. Shared to Maven 🙏👍

  • @willlounsbery-scaife6255
    @willlounsbery-scaife6255Ай бұрын

    Excellent podcast. You ask such good questions, and it is clear that you put a lot of work and deep thought into preparing for these interviews.

  • @confusedwouldwe
    @confusedwouldweАй бұрын

    I set playback speed to 1.25 at the start of the vid (I often do for these kinds of podcast-type interviews), god damn I was not prepared for how fast Dwarkesh talks 😆

  • @klarad3978
    @klarad3978Ай бұрын

    I love Dwarkesh’s intelligent and pointed questions, it’s refreshing.

  • @nicohillbrand3124
    @nicohillbrand3124Ай бұрын

    Your podcast has become my new favourite, overtaking the 80k podcast. Really love the quality of your questions :)

  • @ulychun
    @ulychunАй бұрын

    Dwarkesh meets Demis ! Fantastic interview ! Every sentence is gold…❤

  • @riazr88
    @riazr88Ай бұрын

    Yo Papa Patel interviewing the heavy hitters. Much appreciated

  • @bazstraight8797
    @bazstraight8797Ай бұрын

    20 minutes in "Grounding (in reality)", I had to pause: these are astute questions from Dwakesh and great replies from Demis.

  • @agginswaggin
    @agginswagginАй бұрын

    Your channel is gold! I love your questions, and crazy how you can get all these big guys on here

  • @En1Gm4A
    @En1Gm4AАй бұрын

    Thanks for the Interview. Very much appreciate it!

  • @hamandchees3
    @hamandchees3Ай бұрын

    Given the pace of change I'd love if you'd include the date of recording in the description.

  • @user-kh9hq6iw1o
    @user-kh9hq6iw1oАй бұрын

    Amazing background research by Dwarkesh, citing old research papers from Demis is great.

  • @log0n
    @log0nАй бұрын

    You are my favorite interviewer. Thank you for the interesting content!

  • @noone-ld7pt
    @noone-ld7ptАй бұрын

    This podcast is so incredibly underrated. Fantastic conversation with one of the most important people in the field. Your research and knowledge really shines here and serves as the foundation for some really insightful deepdives. Thank you so much for this!

  • @videowatching9576
    @videowatching9576Ай бұрын

    Great interview! Is this accelerated beyond 1.0x? Such as 1.1x or 1.2x playback as the default?

  • @bobby288m

    @bobby288m

    Ай бұрын

    my money is on amphetamines

  • @HuxleyCrimson

    @HuxleyCrimson

    Ай бұрын

    @@bobby288mlol that's what I secretly thought haha 😅😂

  • @Jonathan2x6

    @Jonathan2x6

    Ай бұрын

    Mumbo jumbo to deliberately obfuscate. The interviewer just rambles on instead of keeping the question short. Also got a fake accent that falls flat at times.

  • @bastost
    @bastostАй бұрын

    This is becoming one of my favorite podcasts.

  • @Josh-dp1uw
    @Josh-dp1uwАй бұрын

    You did a really good job and I learned a lot without losing interest. Thank you.

  • @arturt7192
    @arturt7192Ай бұрын

    Finally a sharp interviewer who knows what he is talking about. Great job!

  • @treesandgeeking
    @treesandgeekingАй бұрын

    Great stuff Dwarkesh ❤

  • @propilot7428
    @propilot7428Ай бұрын

    You ask really good questions! Very good work 👌

  • @asherifs9383
    @asherifs938314 күн бұрын

    Hey love your Interview sometimes hard to understand your questions, your a fast speaker. But your very good at what you do, thank you for the content.

  • @vish202uk5
    @vish202uk5Ай бұрын

    Truly inspiring. Fantastic talk.

  • @travisstewart8655
    @travisstewart8655Ай бұрын

    Sounds like I’m watching a regular podcast at 1.5 speed

  • @mattwesney
    @mattwesneyАй бұрын

    What a fantastic interview and interviewer! Kudos

  • @PR-kz9kx
    @PR-kz9kx4 күн бұрын

    Awesome feedback. A piece of advice for the interviewer. Please don't rush when you pose a question. Slow down and speak clearly. IN several cases the posed questions were disregarded due to the speed.

  • @CristianDobre983
    @CristianDobre983Ай бұрын

    Only one hour… 😢

  • @the_badass_bond___

    @the_badass_bond___

    Ай бұрын

    It should've been 3 hours mann

  • @conformist

    @conformist

    Ай бұрын

    better than zero!

  • @ansumansamal8473

    @ansumansamal8473

    Ай бұрын

    But it's a quality 1hr

  • @the_badass_bond___

    @the_badass_bond___

    Ай бұрын

    @@ansumansamal8473 so ja bhai. Rat ho gya

  • @Aziz0938

    @Aziz0938

    Ай бұрын

    ​@@the_badass_bond___tu chup

  • @andersfant4997
    @andersfant4997Ай бұрын

    Great interview👍

  • @trevorsmissaert5687
    @trevorsmissaert5687Ай бұрын

    great questions for sure. Very good interview.

  • @michaelneumaier5912
    @michaelneumaier5912Ай бұрын

    Great episode, always amazing people you are able to interview! Other than the content itself, I feel like you're 99% there in terms of production quality. The audio is sounding better than it has in the past which is a welcome change, but I can't help but notice the video having some auto exposure artifacts. It is somewhat distracting to see the exposure change when someone is moving in a certain way. Also the exposure in general seems a little overexposed. Just trying to give some technical feedback! I always look forward to your interviews! I can't wait to see what these conversations will be about in 2 or 3 years when we understand more.

  • @sioncamara7
    @sioncamara7Ай бұрын

    10 minutes in and this is excellent!

  • @fredrik241
    @fredrik241Ай бұрын

    Demis: These system are going to be enormously powerful and transformative to society! also Demis Demis: Because these systems are potentially dangerous if falling into the wrong hands only selected people and institutions should be able to wield them.

  • @41-Haiku

    @41-Haiku

    Ай бұрын

    Also Demis: "We don't know how to control these systems once they become smarter than us, but just trust us, we'll figure it out later!"

  • @ExosfeerPrivate
    @ExosfeerPrivateАй бұрын

    Very good interview, well done 🎉

  • @adriansomor
    @adriansomorАй бұрын

    Really cool videos, thanks for doing this!

  • @En1Gm4A
    @En1Gm4AАй бұрын

    It's the most sophisticated asking I have see on the topic last 7 month.

  • @parisfrancepp
    @parisfranceppАй бұрын

    Incredibly useful, Chelsea Finn is clearly one of the most inspiring robotics researcher nowadays

  • @stevenahrens1655
    @stevenahrens1655Ай бұрын

    Dwarkesh is purely an AI simulation that Demis was testing. Notice how Demis had him running at wildly different playback speeds throughout the interview.

  • @user-mu3th2bz3g
    @user-mu3th2bz3gАй бұрын

    Great interview

  • @collins4359
    @collins4359Ай бұрын

    love demis. he's very open.

  • @alexmolyneux816
    @alexmolyneux816Ай бұрын

    I love this more technical style interviews from someone who knows the domain. This is missing from the internet. I will love you to do a similar with Sam Altman 🔥

  • @derekjordan1958
    @derekjordan1958Ай бұрын

    the youtube url ends with AI

  • @VesperanceRising

    @VesperanceRising

    Ай бұрын

    Awesome

  • @netscrooge
    @netscroogeАй бұрын

    Great work! By the way, it would be great if you would always post the interview date.

  • @yoyo-jc5qg
    @yoyo-jc5qgАй бұрын

    Cool, 1.5x speed without the 1.5x playback speed

  • @umberto488

    @umberto488

    Ай бұрын

    Lots of brain power

  • @IyamwhoIyam
    @IyamwhoIyamАй бұрын

    Perfect listening for a walk in the forest. ✌️

  • @FORGOTTEN-THEORY
    @FORGOTTEN-THEORYАй бұрын

    AGI in the next 5 minutes!

  • @jakek82
    @jakek82Ай бұрын

    Thanks!

  • @K1NG.Z3R0
    @K1NG.Z3R0Ай бұрын

    This podcast is the only one I listen to at 1x speed O.O great job with the quick pacing, Dwarkesh!

  • @93836

    @93836

    Ай бұрын

    After rewinding a bunch of times, I eventually just set it to 0.5x speed for me. Haha.

  • @nescirian

    @nescirian

    Ай бұрын

    I listened to it at 1.5x because that's what I'm used to, but I did have to stop and check that it hadn't somehow ended up at 2x. Definitely seemed faster than usual.

  • @ashh3051

    @ashh3051

    Ай бұрын

    I'm listening at 0.75x. The pace is too intense for me.

  • @ModernCentrist
    @ModernCentristАй бұрын

    I love interviews like this that get a bit more technical.

  • @viaMac
    @viaMacАй бұрын

    Needs more views

  • @joshuasellers4434
    @joshuasellers4434Ай бұрын

    Let's go!

  • @dr_cheez811
    @dr_cheez811Ай бұрын

    Have you considered running the mic through a sound board and equipping you and your guests with monitor headphones? It might be a good way to prevent guests from wandering away from the mics if they can hear themselves.

  • @dr_cheez811

    @dr_cheez811

    Ай бұрын

    I say sound board because my experience with digital monitors has been closer to a speech jammer.

  • @filosofiahoy4105
    @filosofiahoy410518 күн бұрын

    It will be a real challenge for an IAG to "feel" what I felt witnessing the eclipse today. Because It can't be explained with words.

  • @workingTchr
    @workingTchrАй бұрын

    We all now know that "weights" are where the big security danger lies.

  • @egor.okhterov
    @egor.okhterovАй бұрын

    "Sure, sure, sure, yeah, yeah, yeah" - it translates something like this "please, shut up. I'm not listening to you anymore. The things you are talking about now are not interesting to me. I want to talk myself now instead of you"

  • @conall5434
    @conall5434Ай бұрын

    Lets go!!!

  • @abhyudaypatel
    @abhyudaypatelАй бұрын

    Exciting

  • @Sandakahleh
    @Sandakahleh6 күн бұрын

    Get Ilya Sutskever on the podcast!

  • @vinipoars
    @vinipoarsАй бұрын

    Brilliant humble man who is fronting maybe the most important endeavour of humankind right now. Deep respect for Dr. Demis Hassabis. Great interviewer.

  • @roomo7time
    @roomo7timeАй бұрын

    This is gold

  • @Glowbox3D
    @Glowbox3DАй бұрын

    Let's get this right!

  • @JakeWitmer
    @JakeWitmerАй бұрын

    Stanley Milgram's "Obedience to Authority: An Experimental View" needs to be discussed at the center of every discussion about why both AGI and existing humans are so unwise. We know the answers...we're just too cowardly to face them and choose wisely.

  • @bmoney6482
    @bmoney6482Ай бұрын

    Wish it was longer

  • @user-dd2dd3fm7f
    @user-dd2dd3fm7fАй бұрын

    When published, it "was" the best model. Not today.

  • @dr.mikeybee
    @dr.mikeybee22 күн бұрын

    I think the best way to study the activation space is by perturbation analysis which can be automated.

  • @kuang-chengyushankao1395
    @kuang-chengyushankao1395Ай бұрын

    謝謝!

  • @JC-ji1hp
    @JC-ji1hpАй бұрын

    Banger

  • @JakeWitmer
    @JakeWitmerАй бұрын

    56:40 Speaking of "Unintended Consequences," that's a book Demis should read. The John Ross one with "the rape of liberty" art on the cover (there are two books called "Unintended Consequences" by two different guys named John Ross).

  • @oraz.
    @oraz.Ай бұрын

    It's weird that a company can have a division with the best minds and then another of quasi technical ethics ladies and functionaries are allowed to make the final product into farce.

  • @gysbertbremer8284
    @gysbertbremer8284Ай бұрын

    Empirical truth. Nascent AGI suits men of thunder. Walking light on the battlefield.

  • @ryzikx
    @ryzikxАй бұрын

    very hella swag podcast

  • @jondor654
    @jondor654Ай бұрын

    Just curious , in a differential piece game like chess is there any role for lower order /complexity auxillary modelling purely on a board demographic , ie positional state .

  • @mahon257
    @mahon257Ай бұрын

    Many models in the brain are inherited (innate) - such as being able to catch a ball, under the effect of gravity and air resistance. Therefore, human brain models are developed, then improved across generational boundaries. The amount of data used to train our internal models is therefore captured across 10's of thousand of years. With AI, we are massively accelerating that process.

  • @LegendStudioGames
    @LegendStudioGamesАй бұрын

    Does anyone know what the make and model of those chairs are? They look slick.

  • @SigmoidalHive
    @SigmoidalHiveАй бұрын

    what a rehabilitating episode

  • @b_two
    @b_twoАй бұрын

    Can we get the podcast in video form on Spotify please 🙏

  • @MrRonjivkroy
    @MrRonjivkroyАй бұрын

    Demis called LLMs unreasonably effective. Shouldn't we figure out the reason why it's as effective as it is. And furthermore, how does higher quality or extra data improve its IQ in certain domains? If something this unprecedented is "unreasonably effective", we should figure out the method to the madness instead of blindly creating more madness.

  • @dr.mikeybee
    @dr.mikeybee22 күн бұрын

    Are you using elastic weight consolidation and curricular training?

  • @ChipWhitehouse
    @ChipWhitehouseАй бұрын

    FANTASTIC interview but have you ever noticed that you, Dwarkesh, speak like you are on 1.5x speed? 😭😭😭 Kind of obsessed and I don’t know how you talk like that.

  • @malimal4972

    @malimal4972

    Ай бұрын

    it's sped up

  • @ChipWhitehouse

    @ChipWhitehouse

    Ай бұрын

    @@malimal4972 I don’t believe that… why would he speed up his part and not Demis’s? Demis talks at his normal speed?

  • @malimal4972

    @malimal4972

    Ай бұрын

    read other comments

  • @ChipWhitehouse

    @ChipWhitehouse

    Ай бұрын

    @@malimal4972 sounds like a lotta work… 🤔

  • @altruistx
    @altruistxАй бұрын

    Dwarkesh loves pushing doom scenarios over positive possibilities and opportunities. ngmi

  • @nicklausbrain
    @nicklausbrainАй бұрын

    What makes it best model in the world exactly?

  • @DanEne
    @DanEneАй бұрын

    Please stop boostimg speed on these videos, it's already hard to keep up as it is 😁

  • @hypercube717
    @hypercube717Ай бұрын

    Interesting.

  • @juliandunn8412
    @juliandunn8412Ай бұрын

    This is fundamentally the last technology humans will ever invent. Once AGI is achieved and released, it will make all of our future inventions...

  • @macabrew
    @macabrewАй бұрын

    Decade? You can say that, we're basically there.

  • @ms-mr8kg
    @ms-mr8kgАй бұрын

    Interesting how youtube comments are having a meta discussion about the conversation instead of the conversation itself.

  • @skierpage

    @skierpage

    Ай бұрын

    Folks, if you like the video click the thumbs up button. There's NO NEED to write about how much you liked it!

  • @420_gunna
    @420_gunnaАй бұрын

    Do Nate Lambert on practical/open-source alignment research! 😄

  • @420_gunna

    @420_gunna

    Ай бұрын

    I think he'd have something something to say about Demis's claims at 43:00 re: their work being either "open source" _or_ "open science" 😄

  • @akratlapidus2390
    @akratlapidus2390Ай бұрын

    Very interesting interview but the acceleration effect was annoying.

  • @KhalkeionGenos
    @KhalkeionGenosАй бұрын

    While I appreciate the interview, I can't help but feel disappointed you didn’t address the elephant in the room - the growing concerns about potential biases, especially the alleged anti-white bias, in Google's new AI image generator.

  • @VividhKothari-rd5ll
    @VividhKothari-rd5llАй бұрын

    Here we go. That's why I don't open KZread first thing in the morning.

  • @LarsRyeJeppesen

    @LarsRyeJeppesen

    11 күн бұрын

    I am 1 + hours late for work now

  • @mrpicky1868
    @mrpicky1868Ай бұрын

    by what metric are you calling Gemini best model? by google advertisement statements?

  • @skierpage

    @skierpage

    Ай бұрын

    By the incredible Google video where Gemini was watching the presenter and cracking jokes while he drew a rubber ducky and put a map on the table. Amazing stuff, shame it was faked.

  • @ShawnFumo

    @ShawnFumo

    Ай бұрын

    In fairness, I think 1.5 Pro can be considered better in terms of dealing with long context. I got access today and it is pretty impressive so far. Like with a half hour video tour of a museum, I asked which exhibit had an animal digging near water and who gifted it to the museum. And it got it even with the length and the fact the name placard, animals, and gift placard weren’t all on screen at the same time.

  • @ShawnFumo

    @ShawnFumo

    Ай бұрын

    Google has been shooting themselves in the foot a lot. Instead of doing that stupid fake marketing video, they should have waited for 1.5, when they could actually show something very impressive. 1.0 Ultra is basically just GPT-4 with pluses and minuses (overall more minuses). 1.5 is something different altogether. We haven’t seen a model until this one that can actually reason well over a very large context. Hopefully they’ll be able to roll it out to more people without a huge delay. Am hoping it is a good sign I got past the waitlist, since I’m not a famous influencer or anything like that.

  • @oraz.

    @oraz.

    Ай бұрын

    ​@@ShawnFumoThere are still many answers that will be manipulated or not allowed. I guess it's up to people to decide if they are fine with that.

Келесі