Groq CEO Jonathan Ross - Tech Giants in the Generative AI Age

Ғылым және технология

Jonathan Ross is the founder and CEO of Groq, a company that develops high performance microchips purpose built for AI and machine learning. Prior to founding Groq, Jonathan invented Google’s AI processor, the TPU. #AI #Groq #semiconductors
Looking for more data news? Follow us on Twitter @worldofdaas / worldofdaas 🌐 The trusted news feed on Data-as-a-Service (DaaS) companies and products 🌐
---------------------------------------------------------
00:00 Jonathan Ross - Founder and CEO, Groq
00:57 Transition to generative AI age
12:36 Companies with the biggest advantages in AI age
19:01 NVIDIA
31:29 Apple in the AI race
41:15 Semiconductor supply chains
40:44 Moore’s Law
57:09 Conspiracy theories
58:52 Jonathan Ross’s take for common bad advice
---------------------------------------------------------
Guest Socials:
Twitter: / jonathanross321
LinkedIn: / ross-jonathan
🎧 Listen to World of DaaS:
Spotify: bit.ly/3P6BBHL
Apple Podcasts: apple.co/3sNyjBJ
Buzzsprout: bit.ly/3LkuGJN
Host Auren Hoffman Socials:
Twitter: / auren
Substack: substack.com/@auren
World of DaaS is brought to you by SafeGraph & Flex Capital.
SafeGraph: safegraph.com
Flex Capital: flexcapital.com
Follow World of DaaS @WorldOfDaaS
Editing and post-production work for this episode was provided by The Podcast Consultant (thepodcastconsultant.com)

Пікірлер: 37

  • @FutureGuy47
    @FutureGuy47Ай бұрын

    Dude, stop interrupting him all the time.

  • @kristopherleslie8343

    @kristopherleslie8343

    Ай бұрын

    Agreed 😊

  • @Superahh

    @Superahh

    Ай бұрын

    Yeah lol

  • @420_gunna
    @420_gunna29 күн бұрын

    Host is actually _good_ at interrupting in the sense that he seems to know the best times to kill interesting lines of thought from Groq man

  • @Drackomass
    @DrackomassАй бұрын

    That was a really good episode, thank you for having it and sharing it. Jonathan Ross is really smart.

  • @worldofdaas

    @worldofdaas

    Ай бұрын

    Glad you enjoyed it! Jonathan is amazing!

  • @peter_phamous
    @peter_phamousАй бұрын

    Really awesome guest! And while you're getting some warranted criticism on cutting off your guest too frequently, you asked some really excellent questions! But perhaps like Jonathan's point where LLM's, given more compute will produce much more beneficial responses, your questions can similarly benefit 😅. But well done, absolutely subscribed!

  • @frediv8
    @frediv828 күн бұрын

    Love how he is challenging the concept of data gravity.

  • @andrewlewin6525
    @andrewlewin6525Ай бұрын

    Love the energy, but let him finish a thought 😂 but great stuff !!

  • @worldofdaas

    @worldofdaas

    Ай бұрын

    Thanks for watching!! Please subscribe and share :)

  • @bstewartny
    @bstewartnyАй бұрын

    You can't have compute without electricity, energy (oil, nat gas, coal, nuclear, etc). It's unlikely solar, wind and hydro can provide enough power in the short term for all these data centers full of GPUs. There will be huge incentive to make these GPU more energy efficient. And smaller more efficient models. And smaller models which can run on more efficient CPUs and not even need GPU necessarily (and even run locally on your own CPU - see LLama3 8B model for example)

  • @worldofdaas

    @worldofdaas

    Ай бұрын

    Agree!

  • @TheFeedRocket

    @TheFeedRocket

    28 күн бұрын

    100% this, the models will get more efficient, smaller and smarter, by magnitudes, it will be possible to run and train AI multiple times better than ChatGPT on computers at home. We will look back at these massive fan and water cooled GPU's we use at home now as a joke, we still will have those, they will just be that much more powerful and cutting edge. We will run realtime extremely powerful AI models on computers at home in a year or so. They know that, and that is not their main goal really, the goal is to beat the other guy to super intelligence at all costs NOW. It's not about efficiency, not even about cost, it's just about winning the race, we have never seen anything like this. Lots of $$$ going into tech right now, things are accelerating more than ever on all fronts.

  • @militiamc
    @militiamcАй бұрын

    Interviewer keeps interrupting speaker just to ask basic questions or provide already obvious or sometimes flat out wrong examples. Regardless still a great interview.

  • @worldofdaas

    @worldofdaas

    Ай бұрын

    is this negging?

  • @thriceborn7665

    @thriceborn7665

    Ай бұрын

    @@worldofdaas Not negging. It's real feedback. Good interview but would be great if you let this man cook lol. Best interviewers let their guest complete their thoughts without interruption.

  • @worldofdaas

    @worldofdaas

    Ай бұрын

    @@thriceborn7665 that's fair. always appreciate feedback

  • @thriceborn7665

    @thriceborn7665

    Ай бұрын

    @@worldofdaas You got it man. I appreciate the work regardless. Great content here.

  • @videowatching9576
    @videowatching957628 күн бұрын

    Fascinating episode!

  • @Iamguilherme
    @Iamguilherme26 күн бұрын

    Awesome ideas.

  • @dimknaf
    @dimknafАй бұрын

    stop interrupting. He was talking, and when he was about finishing to say the most important thing, you interrupt him. It makes the whole interview so annoying... He tries to come back to what he said to conclude and interrupt him again. Apart from this, great interview..

  • @chirag2819
    @chirag2819Ай бұрын

    Everyboding saying Auren came across odd, I guess he was just trying to clarify things.

  • @worldofdaas

    @worldofdaas

    Ай бұрын

    Thanks for the nice comment - appreciate it :)

  • @user-gc9sp7bx5z
    @user-gc9sp7bx5zАй бұрын

    evga was the company nvidia bankrupted

  • @RussianQueenIrina
    @RussianQueenIrina29 күн бұрын

    He should have named it "reality potion" of Generative AI

  • @davidvasco
    @davidvascoАй бұрын

    which research found this claim? "when they paired a human doctor with the AI the uh results were worse than just having the AI give a diagnosis"

  • @paultparker

    @paultparker

    Күн бұрын

    I don’t remember, but I did see the actual chart. Look at Google‘s medical LM research: med Gemini, or something like that. I think that that was where it was, although it could’ve been a paper on GPT4 in medicine.

  • @ps3301
    @ps3301Ай бұрын

    Groq is trying to sell itself to apple..groq is using Samsung foundry for the next gen chip. Not north American supply anymore

  • @markwvh

    @markwvh

    26 күн бұрын

    Actually, the Samsung foundry is based in Taylor, Texas, USA.

  • @user-ey6fd9im8o

    @user-ey6fd9im8o

    19 күн бұрын

    Great choice of Samsung over TSMC. GL XD

  • @blackgptinfo
    @blackgptinfo19 күн бұрын

    I still disagree with him about jobs. The distinction between coal engines and pace of change as he initially mention of AI adoption is significantly fsster. Slow change is adaptable, fast change requires a long time to balance out frictional employment.

  • @mickelodiansurname9578
    @mickelodiansurname957829 күн бұрын

    Right now Groq's main use case, speed, is being throttled by Groq due to demand... But I suppose if you are just building and testing its okay... still really annoying though.

  • @eatdirtnetwork
    @eatdirtnetwork29 күн бұрын

    The fact that he was dishonest w the last 2 questions proves he is a person disconnected w reality

  • @jonnagap87
    @jonnagap87Ай бұрын

    What a terrible host! The host is clearly insecure and tries to prove to the guest he understands what he is being told by giving out unrelated and nonsensical analogies. Your follow up questions clear show that you are playing out of your league. Please let the guest completely present their idea instead of constantly trying to prove your capabilities!!

  • @cheese9812
    @cheese9812Ай бұрын

    worst interviewer ever. just interrupts his guest the entire time. hes as bad as kara swisher

Келесі