Jim Keller - Moore's Law in the age of AI Chips

Ғылым және технология

For more talks and to view corresponding slides, go to scaledml.org, select [media archive].
Presented at the 5th Annual Scaled Machine Learning Conference 2020
Venue: Computer History Museum
scaledml.org | #scaledml2020

Пікірлер: 79

  • @steveseeger
    @steveseeger3 жыл бұрын

    I graduated computer hardware / ECE in 2007 and went into software because of exactly this erroneous thought 'what jobs will there be in 10 years when Moore's law is dead'. If any young person is watching, listen to Jim.

  • @dennis_johnson

    @dennis_johnson

    3 жыл бұрын

    What are some cool places/companies in this space that you know of?

  • @karthik3685

    @karthik3685

    2 жыл бұрын

    companies only very recently pay HW engineers close to SW, so still might not have been a bad idea to go into Software, unless you're super interested in designing hardware.

  • @albionnika
    @albionnika3 жыл бұрын

    Jim Keller really loves Comic Sans since he seems to use it in every presentation

  • @leixun
    @leixun4 жыл бұрын

    *My takeaways:* 1. Compute models: Scalar, Vector, Matrix and Spatial 13:50 2. Data models: global memory vs local memory 16:15 3. It is extremely difficult to write SIMD program 18:25 4. GPU is not SIMD 19:31, GPU running a vector of scalar programs that share a global memory 20:08 5. AI chips 21:20

  • @PauloConstantino167

    @PauloConstantino167

    3 жыл бұрын

    those are not takeaways, those are time stamps

  • @maggiejetson7904

    @maggiejetson7904

    3 жыл бұрын

    There was a talk from a guy who used to work for Intel, he mentioned that he was benchmarking a vector of scalar program doing the same thing as the SIMD program optimized by Intel's internal compiler people, and the vector of scalar beats it because it does not have to wait around each other like the SIMD does.

  • @bnb7094
    @bnb70943 жыл бұрын

    I learned more from this video than any hype out there from individual companies. I mean, I'm more excited from this video for future technologies than anything I've seen in the past.

  • @jaitanmartini1478
    @jaitanmartini14784 жыл бұрын

    Very insightful! Thanks!

  • @TheEtrepreneur
    @TheEtrepreneur4 жыл бұрын

    Jim Keller? that's a like from me.

  • @mukiex4413

    @mukiex4413

    3 жыл бұрын

    Man I wish I had another 1,000 likes to pile on that. How many of the top emerging CPUs did he NOT have a hand in? Apple's M1? Swift and Cyclone were his babies. Ryzen? Check. If Tesla ever makes self-driving happen, it will have been on his architecture. If Microsoft follows Apple and hands AMD a fat stack of cash for K12, that will be a twofer for 'ole Keller. I'm excited to see his second AI architecture come out.

  • @MatthewKanwisher
    @MatthewKanwisher4 жыл бұрын

    Great talk thanks

  • @dkutagulla
    @dkutagulla2 жыл бұрын

    Comp Arch 101 Jim Keller made ,me remember my entire comparch course from over 14+ years ago

  • @erikm9768
    @erikm97682 жыл бұрын

    Isnt 2^60 more like an exa byte?

  • @JLSwagger
    @JLSwagger3 жыл бұрын

    Comic sans

  • @truboxl
    @truboxl3 жыл бұрын

    I'd like Jim to revisit this since its ironic for him to defend Moore's Law until leaving Intel

  • @nlysts

    @nlysts

    3 жыл бұрын

    You should watch the lex fridman podcast

  • @Yunn_Jay
    @Yunn_Jay4 жыл бұрын

    I really need some Korean subtitles.. Can somebody help me..?

  • @vn88ttt

    @vn88ttt

    4 жыл бұрын

    Google how to download generated English subtitles, then write an automated script to Google translate each line into Korean.

  • @alexm4161

    @alexm4161

    3 жыл бұрын

    If you turn on automatic subtitles, you can also select "auto-translate" for Korean.

  • @asdfghjkl1755
    @asdfghjkl17553 жыл бұрын

    0:33 technology optimism talk by who?

  • @jakovmarinvezic2364

    @jakovmarinvezic2364

    3 жыл бұрын

    Riva Tez

  • @asdfghjkl1755

    @asdfghjkl1755

    3 жыл бұрын

    @@jakovmarinvezic2364 thank you

  • @DanieleGiorgino
    @DanieleGiorgino4 жыл бұрын

    What a great talk. Can't wait to see Jim do to Intel what he did to AMD.

  • @kmolnardaniel

    @kmolnardaniel

    4 жыл бұрын

    not anymore :(

  • @edh615

    @edh615

    3 жыл бұрын

    @@kmolnardaniel intel is done

  • @Jaker788

    @Jaker788

    3 жыл бұрын

    Jim Keller can only help those who are willing to listen and do what he says needs to be done. No doubt he's helped the architecture team, but I don't think Intel was as willing as AMD, Apple, or Tesla to listen.

  • @DanieleGiorgino

    @DanieleGiorgino

    3 жыл бұрын

    @@Jaker788 Yup.

  • @erikm9768

    @erikm9768

    2 жыл бұрын

    He's not at Intel... they burned that chance

  • @NDakota79
    @NDakota792 жыл бұрын

    If you don't know this guy he may come across like a wheat farmer from Alabama. Then you realize he is one of the smartest people in the world.

  • @christopherchang6378
    @christopherchang63783 жыл бұрын

    anyone betting against intel in recent news is betting against keller's brilliance

  • @M.-.D

    @M.-.D

    3 жыл бұрын

    This did not age well.

  • @christopherchang6378

    @christopherchang6378

    3 жыл бұрын

    @@M.-.D what do you mean? Intel has continued to set record revenues and beat expectations, and products bearing raja and keller's impact won't even release until later this year. EASY money.

  • @ttb1513

    @ttb1513

    3 жыл бұрын

    @@christopherchang6378 it might have to do with Keller leaving Intel.

  • @Lisa_Minci96

    @Lisa_Minci96

    3 жыл бұрын

    @@christopherchang6378 found the intel shareholder

  • @christopherchang6378

    @christopherchang6378

    3 жыл бұрын

    @@ttb1513 yah, cause his bro-in-law was dying. his stints are usually longer than a couple of years anyway.

  • @Yolo_Swaggins
    @Yolo_Swaggins3 жыл бұрын

    A.I is the schizophrenia of computing

  • @Kynareth6
    @Kynareth64 жыл бұрын

    If Moore's Law is not dead, then why can't you buy a 64x more transistors and 64x faster CPU than i7-920 from 2008 (which costed only $284 for 4 cores, 8 threads and 8 MB of L3 Cache at 2.8 GHz all-core with good OC capabilities)? That would be 46 784 million transistors. Far more than 10900K which costs $488 and has a useless iGPU.

  • @Kynareth6

    @Kynareth6

    4 жыл бұрын

    Core 2 Quad Q6600 came out in Q1 2007 for $851 and was coming down in price with every passing month. Core i7-920 came out in Q4 2008 for $284 and is ~68% faster at maximum OC on both. These are the changes I was accustomed to. If you compare $999 i7-5960X from Q3 2014 and the newest $237 i5-10600KF, they have very similar performance. So less improvement and innovation in about 6 years than earlier in less than 2 years. Very frustrating. So little has changed since i7-920 was released back in 2008... 10900K has only 2.5x more cache.

  • @RyNiuu

    @RyNiuu

    4 жыл бұрын

    @@Kynareth6 yeah I had X3440 which could be overclocked to 3.8GHz. it was great for over 6 years.

  • @teamrocket9684

    @teamrocket9684

    4 жыл бұрын

    2990wx is >20B transistors, 3990x is >32B transistors. Personal PC chip has stalled but workstations and servers are still going. Back in the core 2 times server & pc chips were on same line

  • @Kynareth6

    @Kynareth6

    4 жыл бұрын

    @@teamrocket9684 Intel workstation CPU in 2010 - 6 cores. In 2020 - 18 cores. Only 3x for the same money after 10 years. This is also stagnation. Threadripper 3990X costs 4x much as 6 cores in 2010 so does not count.

  • @kiranchandveernapu318

    @kiranchandveernapu318

    3 жыл бұрын

    its not dead, its just slowed down!

  • @CharIie83
    @CharIie833 жыл бұрын

    who said bums cant learn to code

Келесі