Meteor Lake: AI Acceleration and NPU Explained | Talking Tech | Intel Technology

Ғылым және технология

The PC industry is at a significant inflection point, and with Meteor Lake, we’re bringing AI to client computing at scale. Join us as we sit down with Darren Crews, Sr. Principal Engineer, AI SW Architecture and Intel Fellow Tom “TAP” Petersen as they explain how the Intel Core Ultra delivers AI acceleration across the CPU, GPU, and our new NPU (or neural processing unit). You’ll learn how the NPU is optimized to handle dense and sustained AI workloads efficiently. We also discuss why it’s crucial to focus on software and APIs to create a friendly developer experience. Talking Tech goes in depth on Meteor Lake with Intel architects and engineers: intel.ly/3MmhpRl
VP of Design Engineering Group Tim Wilson explains Meteor Lake in Architecture All Access: intel.ly/3Spf6ku
Chapters:
00:00 - Intro
00:33 - Purpose and role of the NPU
01:45 - APIs
02:24 - NPU compute engines explained
05:06 - Drivers and software
06:56 - Bringing AI to client
09:25 - Conclusion
About Intel Technology: Intel has always been at the forefront of developing exciting new technology for business and consumers including emerging technologies, data center servers, business transformation, memory and storage, security, and graphics. The Intel Technology KZread channel is a place to learn tips and tricks, get the latest news, and watch product demos from both Intel and our many partners across multiple fields.
Connect with Intel Technology: Visit Intel Technologies WEBSITE: intel.ly/IntelTechnologies Follow Intel Technology on TWITTER: intel.ly/3MmhqET

Пікірлер: 29

  • @typingcat
    @typingcat5 ай бұрын

    The reason most A.I. is done in cloud is lack of VRAM. For years, GPU companies have been milking on VRAM, just like Apple charging a fortune for memory upgrades. I do hope CPU's take over GPU in regard to A.I. processing so we average consumers don't have to spend thousands of dollars just to get 32GB of VRAM.

  • @octaviusp

    @octaviusp

    10 күн бұрын

    i think that would happen the same as cores in cpu. Intel monopoly followed this rule of static number cores until a new competition (AMD) moves towards a new approach of more cores and unleash that every intel cpu came with more cores than before. I think that now that AMD, Intel are invading the NVIDIA Market, nvidia will create new gpus with highest VRAM for lower prices.

  • @BUY.YT.VIEWS.
    @BUY.YT.VIEWS.6 ай бұрын

    I'm sharing this with all my friends!

  • @Luckyn00bOC
    @Luckyn00bOC6 ай бұрын

    Question : why the Integrated Arc GPU on Meteor Lake not having XMX unit for AI Acceleration? Is it because the Meteor Lake already have an NPU? Or is there some other concerns like power usage? Thanks!

  • @Navierstokes256
    @Navierstokes2566 ай бұрын

    Appreciate the top-down explanation. What would be the potentional gaming applications? I know that XeSS is accelerated through the XMX hardware on the arc GPUs, but a competitor has also been working on NN-based denoisers for Ray/Path tracing. Is Intel going to use the NPU + XMX for such capabilities? General applications are more relevant, of course.

  • @IntelTechnology

    @IntelTechnology

    5 ай бұрын

    Thank you for those kind words! We suggest you to visit our newsroom for upcoming updates via intel.ly/3TwL66D Do not hesitate to DM us if you have any further queries.

  • @__aceofspades
    @__aceofspades6 ай бұрын

    Really excited for Meteor Lakes NPU. Intel showed off a lot of partners, including big names like Adobe that are working directly with Intel on AI software integration. Intel is the only one actually bring AI to everyone. Nvidia GPUs are far too expensive for the average laptop and AMD has zero software support for their NPU. Meanwhile Intel will ship 100 million AI CPUs in 2024.

  • @alphaomega1969

    @alphaomega1969

    5 ай бұрын

    Lol how do software engineer make app for AMD NPU then? 🤣😂💩

  • @novantha1
    @novantha16 ай бұрын

    Any hope of getting a tutorial on getting Meteor Lake set up for running AI through Python and a couple of common libraries for developers? I talk with a lot of people that develop AI apps at the moment (and make a few contributions myself) and I'd like to look at supporting Intel's AI engine, but I don't have one personally, and I'm not sure how well supported it is on Linux (where I do the bulk of my development). A look at the process of getting it setup for development would make a big difference!

  • @SaschaRobitzki
    @SaschaRobitzki6 ай бұрын

    I like to see that in your desktop and workstation CPUs.

  • @KellyClowers
    @KellyClowers3 ай бұрын

    Thanks, I have been trying to find something that would explain a lot of the guts how NPUs work, at a technical but not field expert level... I was hoping for an article, but I haven't found any, so a video will do.

  • @KellyClowers

    @KellyClowers

    3 ай бұрын

    In particular the 4th section, "NPU compute engines explained" is what I was hoping for. An expanded version of that could be even better

  • @bobpritham2660
    @bobpritham26606 ай бұрын

    Intel with this looks promising. I think they purposely made their desktop processors boring to highlight their laptop processors more.

  • @HDRPC

    @HDRPC

    6 ай бұрын

    Arrow Lake Desktop with next Gen CPU cores in 2024.

  • @wallacetran2926
    @wallacetran29266 ай бұрын

    Can the NPU run LLMs locally?

  • @alejandrohoyos8555

    @alejandrohoyos8555

    6 ай бұрын

    Yes it can. It will depend on the "size" of LLM

  • @alphaomega1969
    @alphaomega19695 ай бұрын

    Can NPU be used for video game enemy npc AI?

  • @isekaidev7803

    @isekaidev7803

    5 күн бұрын

    It's up to the devs to implement AI. But currently games don't use NPU kinda AI. They use Behavior tress and state machines for AI which are run on CPU. It's hard coded AI rather than random trained AI. And as for LLMs current NPUs are too weak to run good LLMs.

  • @albiss1164
    @albiss11644 ай бұрын

    Cool new pc era incoming =)

  • @GameHEADtime
    @GameHEADtime5 ай бұрын

    Just waiting to buy it for a desktop pc! Integrate it with peripherals!

  • @DukeAbbaddon
    @DukeAbbaddon6 ай бұрын

    I feel that UltraCore is a mega BASS kind of positivity, But that aside i think maybe intel does adders++ on the internal integer instructions? makes sense to me. RS

  • @And-vx6ry
    @And-vx6ry6 ай бұрын

    Intel please do arc a990 with 4 media encoder decoder, 1440p120fps with higher wattage. Will the upcoming cpus have 24 cores ? Also Music at the end ?

  • @AlexSchendel

    @AlexSchendel

    6 ай бұрын

    Alchemist has had its full stack launched. Intel has limited resources to devote to graphics, so Intel is taking a measured approach to its bet on the complexity of components (lower performance, smaller dies are cheaper to design and produce). As long as Intel continues iterating with Battlemage and Celestial, they'll get there eventually. Larger parts with more Xe Cores will come and the Xe cores will get much more performant very quickly as AXG learns through trial and error where the bottlenecks of their architecture lies. As for CPUs... 24 core CPUs have been out for over a year with the 13900K. The 14900K also has 24 cores. If you're looking for all P-cores, then there's the Xeon w9-3975X as an unlocked, in-box workstation CPU with 36 P-cores.

  • @misterPAINMAKER
    @misterPAINMAKER5 ай бұрын

    Imagine if in a few years videogames require NPU to run.

  • @Zreknarf

    @Zreknarf

    5 ай бұрын

    I read a rumor windows 12 coming in June will require an NPU to run, and the next xbox will have an NPU

  • @misterPAINMAKER

    @misterPAINMAKER

    5 ай бұрын

    @@Zreknarf i hope not

  • @Zreknarf

    @Zreknarf

    4 ай бұрын

    @misterPAINMAKER it looks like GPUs can already do anything NPUs can do, it's just ~50x less efficient. so I imagine you'll be able to run any NPU optimized game on a GPU, just won't be power (or cost) efficient.

  • @aeromotive2
    @aeromotive26 ай бұрын

    shintel baby

  • @Metalmassacre07
    @Metalmassacre076 ай бұрын

    Snakeoil Lake

Келесі