NUMA NUMA make Raspberry Pi go ZOOMA

Ғылым және технология

Raspberry Pi 5 gets 10-15% speedup with 100 line Linux kernel patch. And what if we could save 50 megawatt-hours of power annually, just with a software patch for older Pis?
I'll walk through the NUMA Emulation patch that supposedly boosts Pi 5 performance, as well as some other new performance-related developments coming down the pike!
Mentioned in this video:
- Pi 5 NUMA Emulation Patch: lore.kernel.org/lkml/20240625...
- What is NUMA? lse.sourceforge.net/numa/faq/
- x86 Fake Numa for CPUSets: www.kernel.org/doc/html/v5.8/...
- Pi 1, 3 A+, 3 B+ S2Idle patch: lore.kernel.org/dri-devel/202...
- Raspberry Pi 5 A2 Command Queueing thread: forums.raspberrypi.com/viewto...
- My 2019 blog post on A2 microSD cards: www.jeffgeerling.com/blog/201...
- Pi 5 4GB model outperforming 8GB model: github.com/raspberrypi/firmwa...
- Overvolted Pi 5 from jonatron: jonatron.github.io/randomstuf...
- My video on M.2 NVMe on the Pi 5: • SBCs: It's time to dit...
Support me on Patreon: / geerlingguy
Sponsor me on GitHub: github.com/sponsors/geerlingguy
Merch: www.redshirtjeff.com
2nd Channel: / @geerlingengineering
3rd Channel: / @level2jeff
Contents:
00:00 - There's something off about Pi 5
01:27 - NUMA NUMA?
02:27 - The NUMA Emulation patch
04:29 - 50 MW of power savings (ish)
05:35 - microSD: A2 finally faster than A1
07:18 - Some Pis are slower than others
08:29 - Return of the Bloopers

Пікірлер: 335

  • @alexlandherr
    @alexlandherr23 күн бұрын

    I keep hearing some 20-ish year old pop song when reading “NUMA NUMA”…

  • @Pc_User_Pro

    @Pc_User_Pro

    23 күн бұрын

    Name: Dragostea Din Tei

  • @jonmarler

    @jonmarler

    23 күн бұрын

    Not gonna lie ... I am just the tiniest bit disappointed that we didn't get a tiny little clip of Jeff re-enacting that viral video clip here somewhere ... ;)

  • @DoctorX17

    @DoctorX17

    23 күн бұрын

    God, has it been that long…

  • @vel0city96

    @vel0city96

    23 күн бұрын

    MAYA HEEEE, MAYA HOOOO

  • @roostertechchan

    @roostertechchan

    23 күн бұрын

    I had to pause Jeff and find the song :)

  • @YouCanHasAccount
    @YouCanHasAccount23 күн бұрын

    Wholeheartedly agree with the kernel maintainer. This should be fixed in the firmware and not with some fake NUMA hack that adds eternal technical debt.

  • @guiorgy

    @guiorgy

    22 күн бұрын

    Valid point, but the author also pointed out that the feature already exist for x86_64, so he was just extending it to ARM. Seems a bit unfair to not treat them equally. Then again, it could be argued that the x86 part shouldn't have been there to begin with 🤷‍♂️

  • @s-x5373

    @s-x5373

    22 күн бұрын

    @@guiorgy it exists on x86 for allowing experimenting and virtual machine hacks I believe here it is discussed as a performance patch, it should not be used like that

  • @bepamungkas

    @bepamungkas

    22 күн бұрын

    ​@guiorgy, that's not what the cited commit do. Said commit define arch specific code (under arm64) and promote them to generic since RISC-V also behaves similarly. I.e one code apply to multiple arch, so it make sense to promote them to generic. The newly introduced patch add new behavior either specific to ARM or Pi (the numa_emulation.* files). But the way it implemented, by directly patching base driver, carry the new behavior to base. So there are now 2 codes, one for generic, and one for Pi, both resides in base. IMO, it will be unfair to moved it into base driver (rahter than make it arch specific or move it outside the kernel) since base have dedicated maintainers that may or may not have the capability to verify the changes.

  • @dennispadiernos
    @dennispadiernos23 күн бұрын

    My favorite blooper was "Raspberry Cake"

  • @kevinroosa1315

    @kevinroosa1315

    19 күн бұрын

    It's a slightly wider Raspberry Pi.

  • @Suidloc
    @Suidloc23 күн бұрын

    petition to have these epic oldschool thumbnails from now on.

  • @marcoroose9973

    @marcoroose9973

    22 күн бұрын

    NUMA NUMA

  • @Count_Smackula
    @Count_Smackula23 күн бұрын

    The outtakes make me laugh. Glad I'm not the only one who trips over their words.

  • @sevendaysin8374
    @sevendaysin837423 күн бұрын

    Please keep the outtakes! Funniest way to end every video =)

  • @markarca6360

    @markarca6360

    23 күн бұрын

    @@sevendaysin8374 Reminds me of Technology Connections 💡💡💡💡

  • @Sam-qn4ly
    @Sam-qn4ly23 күн бұрын

    lol, love the thumbnail. the video should have been uploaded in 240p to really fit the vibe :)

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    Heh, and maybe sung throughout!

  • @blackhole7818
    @blackhole781823 күн бұрын

    If You didn't know, your channel had been categorised as a server channel by KZread. Now everytime I watch your videos I get recommendations for home server videos. Alongside yours.

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    Heh, KZread I don't think knows how to categorize things as well as it used to. I watched a video on antenna SWR measurement and now half my feed is ham radio stuff!!!

  • @markarca6360
    @markarca636023 күн бұрын

    NUMA stands for Non-Uniform Memory Architecture. This was already used in supercomputers.

  • @YourWaterDispenser

    @YourWaterDispenser

    23 күн бұрын

    NUH UH its a parody name form the hit song Dragostea Din Tei

  • @Brahvim

    @Brahvim

    22 күн бұрын

    _Huh._ I think I was taught that the "A" stood for "Access".

  • @allenswackhamer5450

    @allenswackhamer5450

    21 күн бұрын

    Its not new at all. All multi CPU machines have it, so basically any server that is running in a DC right now. numatop etc... are old tools

  • @wileamyp

    @wileamyp

    20 күн бұрын

    NUMA is particularly important for compute nodes with multiple CPU sockets or multiple GPUs.

  • @JsemPO12
    @JsemPO1223 күн бұрын

    I know this is totally irrelevant but yesterday I ate the best orange ever

  • @joonasfi

    @joonasfi

    20 күн бұрын

    Congrats! How did it feel coming out?

  • @jasonwnc
    @jasonwnc21 күн бұрын

    Thank you Jeff for bringing back the bloopers! Such a pleasure to watch your videos. I’m sure they are, but I hope the Raspberry Pi Foundation is watching.

  • @SumGuyzClone
    @SumGuyzClone23 күн бұрын

    In one of these bloopers, you need to just roll with it and “skat” to a fake beat. XD

  • @frankbohnen2347
    @frankbohnen234721 күн бұрын

    Every Sunday, I look forward to your videos. Always so informative. Please, more bloopers at the end. It makes it even more joyful to watch and shows how much effort goes into making these videos. THX for creating all this contends.

  • @Neilhuny
    @Neilhuny22 күн бұрын

    Absolutely fantastic video! Surely no-one else packs so much information in to such a small footprint. There is a week's worth of testing, playing, checking, reading and (mainly) head scratching in this video. Most of your videos, tbf

  • @syrus3k
    @syrus3k23 күн бұрын

    Sleep states can be super useful if you're doing battery powered Pi stuff!

  • @foldionepapyrus3441

    @foldionepapyrus3441

    23 күн бұрын

    At the reported power saving not really, its such a tiny change to an already pretty small idle draw. If they can push it further then it would be great, but right now you get more benefit than reported here just dropping the minimum clock speed, and under volting type fiddling, at least on the Pi's I've played with - more power saving is nice though.

  • @syrus3k

    @syrus3k

    23 күн бұрын

    @@foldionepapyrus3441 I have personally only played with the sleep stuff on the Pico which is obviously very different but interesting nonetheless

  • @michaelreed9048
    @michaelreed904822 күн бұрын

    Happy to see the bloopers back :) Thanks for the continued great content!

  • @l0pher
    @l0pher23 күн бұрын

    Thanks for the blooper reel again. Love it

  • @anneallison6402
    @anneallison640222 күн бұрын

    Jeff I began watching your videos just before the pandemic and I can tell you after all this years I finally understand everything you say. You are gold!

  • @greentravels2850
    @greentravels285023 күн бұрын

    "NUMA NUMA" 👍 Interesting look into some issues, I'll have to remember these as they get fleshed out.

  • @mattybbg6850
    @mattybbg685023 күн бұрын

    A doff of the cap to you and your 100% accurate shirt sir!

  • @Rushil69420
    @Rushil6942021 күн бұрын

    Loving the thumbnail shuffle. You screaming up at the Pi is easily my favorite one lol

  • @optical_ideas
    @optical_ideas23 күн бұрын

    Kinda interesting. And outtakes are always great 😄 i wouldn't mind if you include them every video

  • @Kitteh.B
    @Kitteh.B18 күн бұрын

    Thumbnail and outtakes made this a fun video. Thanks for the smiles 💜

  • @Ancipital_
    @Ancipital_22 күн бұрын

    Your content just keeps getting better and better.

  • @nickjohnson410
    @nickjohnson41023 күн бұрын

    Awesome video title. Made me chuckle. Thank you!

  • @haydenc2742
    @haydenc274222 күн бұрын

    Awesome, tweaking the system to make it run faster...always a bonus! Oh man...saving power globally Jeff...gives new meaning of "hack the planet" I really miss the blooper rolls from your video's! Keep em coming!!!!

  • @aquilafasciata5781
    @aquilafasciata57812 күн бұрын

    My Pi 2 has been running 24/7 for the past 4 years as a PiHole server

  • @gregspeakman9337
    @gregspeakman933722 күн бұрын

    Great vid Jeff. It makes sense of the core speeds.

  • @RootiferasRetroGameplay
    @RootiferasRetroGameplay23 күн бұрын

    Ah I'm looking forward to seeing Pi5 overvolt video. There will be smoke!

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    Well... hopefully not, but maybe!

  • @zambonidriver42
    @zambonidriver4223 күн бұрын

    Outtakes! Woohoo! Cracked me up.

  • @Sierra-Whisky
    @Sierra-Whisky15 күн бұрын

    The concept of NUMA deserves so much more attention. Some types of workloads can benefit so much from understanding NUMA and using it right. On the other hand NUMA can cause serious performance degradation when done wrong.

  • @StormWarningMom
    @StormWarningMom21 күн бұрын

    Bloopers at the end giving Technology connections vibes (which are awesome btw)

  • @thomasrolfe8438
    @thomasrolfe843822 күн бұрын

    lol that’s the best thumbnail I’ve seen in years

  • @mikekopack6441
    @mikekopack64418 күн бұрын

    LOVE the bloopers at the end !!!!

  • @willboswell_
    @willboswell_23 күн бұрын

    jeff, i appreciate everything you do. ive learned more shit about computers from your channel than from any friend, teacher, or youtuber

  • @reggiep75
    @reggiep7522 күн бұрын

    Glad to see that I'm not the only one looked up that song and the meme mime video too.

  • @hoyschelsilversteinberg4521
    @hoyschelsilversteinberg452122 күн бұрын

    Your bloopers are so good lol.

  • @davidpower3102
    @davidpower310222 күн бұрын

    The thumbnail is brilliant.

  • @zeljkanenad
    @zeljkanenad23 күн бұрын

    Very insightful! Thank you

  • @iestynd100
    @iestynd10023 күн бұрын

    being this early is proof im chronically online

  • @Josstrigaming

    @Josstrigaming

    23 күн бұрын

    I feel this

  • @MarcoGPUtuber

    @MarcoGPUtuber

    23 күн бұрын

    Hit the bell icon to be early every time. Solidify your chronically onlineness.

  • @djvincon

    @djvincon

    23 күн бұрын

    Same

  • @SpaceDoodle2008
    @SpaceDoodle200822 күн бұрын

    Very descriptive title!

  • @heighRick
    @heighRick22 күн бұрын

    Thanks Jeff, helps a lot!

  • @mjmeans7983
    @mjmeans798322 күн бұрын

    Now that the company has changed, maybe the reason is actually something like this: How do we keep the price from tanking when we have limited production capacity? Fan boys will pay for early access, others will wait. A few months later release improvements to keep it in the news and increase interest to avoid sales drops. If production bottlenecks are eliminated, release all the remaining planned (but secret until then) 'improvements'.

  • @levieux1137
    @levieux113720 күн бұрын

    My own experience has also been that it's mostly memory accesses that make RPis dog slow. Just try to build anything using "make -j $(nproc)" on it and compare with any other board. It's systematically twice as slow as other boards with comparable CPUs running at same frequency, unless you're running single-core. The worst of it is actually that their DRAM random access times are quite good, but that doesn't suffice.

  • @AB-Prince
    @AB-Prince23 күн бұрын

    shoutout to the generation that remembers dragostea din tei.

  • @Rottinator95
    @Rottinator9523 күн бұрын

    Love the outtakes 😂

  • @cognisent_
    @cognisent_15 күн бұрын

    My god, the bloopers are back, hooray! 🎉

  • @allenellisdewitt
    @allenellisdewitt23 күн бұрын

    Numa Numa indeed

  • @Fataha22
    @Fataha2222 күн бұрын

    8:21 I love they just flat out calling out Jeff for the title 🤣

  • @sysadmin-info
    @sysadmin-info2 күн бұрын

    The end is the best. It happens to me very often. :)

  • @jakobfindlay4136
    @jakobfindlay413623 күн бұрын

    I saw both thumbnails this one is much better

  • @foobar6846
    @foobar684619 күн бұрын

    NUMA is super important when you deal with multiple sockets (and chiplets) and things like PCIe passthrough in virtual machines. It's bad enough, performance wise, to have to cross between NUMA cores on the same socket, it's brutal when you do it across sockets. Increased latency, limited bandwidth, you name it. I think I agree with the kernel developer, this is something the firmware should deal with, not something you should emulate in the kernel.

  • @foldionepapyrus3441
    @foldionepapyrus344123 күн бұрын

    The idle power state is pretty cool, though when you are talking less than 3W draw anyway without it and the saving is so small it hardly matters for most Pi users. Though it is always nice to see more support for low power states it really matters so much more when the system actually has meaningful power draw when idle but not in a low power state. Being able to shed 20 or maybe even over 200 watts on a system with much more and higher power hardware is when the low power states really shine.

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    Definitely; I would love to get better idle support (and have software that isn't constantly pinging the Internet (and using CPU cycles) on my AMD workstation... 60W idle!

  • @supaschwamal
    @supaschwamal20 күн бұрын

    Love your Dalek poster. I've got it too!

  • @HurricaneRainbowOG
    @HurricaneRainbowOG22 күн бұрын

    your outtakes were funny :)

  • @PhillipRhodes
    @PhillipRhodes23 күн бұрын

    NUMA NUMA. Also, "nanu, nanu!" 😛

  • @JamesJones-zt2yx
    @JamesJones-zt2yx23 күн бұрын

    Numa Numa...and now I need to go listen to a certain song.

  • @ilovefunnyamv2nd
    @ilovefunnyamv2nd22 күн бұрын

    I'm sure Jeff is trying to tell us something important, but I can think is: Vrei sa pleci dar nu ma nu ma iei Nu ma nu ma iei, nu ma nu ma nu ma iei

  • @terrorpup
    @terrorpup21 күн бұрын

    LOL, I like Jeff how you are trying to hide the camera remote behind the Coffee Mug. That's good to know, thanks for the video. I got my first Raspberry Pi 5 8 Gig a couple of months ago. I kinda one those anger community users, that wasn't happy, well you know. So I figure I give it a tire to see if it's any better, plus I want to update the hardware for my gitlab, that currently still running on RPi 4 x 4. I going to get the Argon V3 and switch from SD to NVMe. Thanks for your videos.

  • @JeffGeerling

    @JeffGeerling

    21 күн бұрын

    Now you know my teleprompter secret!

  • @var67
    @var6723 күн бұрын

    Geerling: Dutch last name. Brolsma: Dutch last name. KOINKIDINK?!?! I think not.

  • @RaduRadonys

    @RaduRadonys

    23 күн бұрын

    Who is Brolsma?

  • @var67

    @var67

    23 күн бұрын

    @@RaduRadonys Gary Brolsma, internet legend who sang Numa Numa on his webcam.

  • @RaduRadonys

    @RaduRadonys

    23 күн бұрын

    @@var67 Thanks, I've never heard of him until now :)

  • @var67

    @var67

    23 күн бұрын

    @@RaduRadonys No shame in that, it's TWENTY years old now.

  • @WillVowels
    @WillVowels19 күн бұрын

    Pi-a-hee! Pi-a-hoo! Pi-a-ha! Pi-a-haha!

  • @RalphHightower
    @RalphHightower20 күн бұрын

    "Intriguing." -- Spock That's interesting and if the code boost makes it to ROM or the kernel. PS: And thank you for not playing that forgettable "Numa Numa" song by that Radar O'Reilly lookalike, otherwise, I would have to Rick-Roll you.

  • @i_Kruti
    @i_Kruti20 күн бұрын

    We need more Behind The Scenes........!!!!

  • @maneeshs3876
    @maneeshs387621 күн бұрын

    Nice video, now it's clear how much Raspberry Pi software is lagging in hardware optimization.

  • @punkdigerati
    @punkdigerati23 күн бұрын

    Each new upgrade felt like an ad segue

  • @chimichanga5964
    @chimichanga596422 күн бұрын

    that thumbnail killed me

  • @JeffGeerling

    @JeffGeerling

    22 күн бұрын

    F

  • @notsonominal
    @notsonominal22 күн бұрын

    _Without recompiling the kernel_ ... but then we don't have a reason to put on a fresh t-shirt?!

  • @pablopoo
    @pablopoo23 күн бұрын

    Sometimes you won't compile release versions with all compiler optimization options turned on, or add some features, for stability reasons, but will be cool to have a distro with all bells and whistles turned on, just for fun :)

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    Raspberry Pi OC OS

  • @iXen000
    @iXen00023 күн бұрын

    NUMA NUMA

  • @benmorris9925
    @benmorris992522 күн бұрын

    Would you be able to a video comparison between the on-board audio jack on a raspberry pi 4 vs a USB audio card? I think there is an interesting history there between board versions. Love your content dude 🎉

  • @scaredyfish
    @scaredyfish22 күн бұрын

    Pet peeve: you can’t multiply Watts like that. 1 Watt for a year is still 1 Watt, because it’s a unit of energy over time. The unit of energy is Watt hours.

  • @JeffGeerling

    @JeffGeerling

    22 күн бұрын

    Should've been 50 MWh (the h is so important there)

  • @Brickkzz
    @Brickkzz23 күн бұрын

    DRAGOSTEA DIN TEI!

  • @karstentopp
    @karstentopp21 күн бұрын

    You just earned one more subscriber.....

  • @wolbart
    @wolbart23 күн бұрын

    Great ending! :)

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    I don't always do bloopers, but sometimes I do :D

  • @kevinwhite9919
    @kevinwhite991922 күн бұрын

    idle would be great, as long as any cec trigger can take it out of idle.

  • @lasersimonjohnson
    @lasersimonjohnson22 күн бұрын

    We NEED Pi hibernation modes.

  • @KG4JYS
    @KG4JYS23 күн бұрын

    lol! I remember using MicroSD cards on orange and raspberry pies. Glad those are a thing of the past.

  • @jeremybarber2837
    @jeremybarber283722 күн бұрын

    Numa numa!

  • @aarocka11
    @aarocka1123 күн бұрын

    Numa Numa Yay!!!!!

  • @selbie
    @selbie21 күн бұрын

    Bold of you to summon the ancient lore. I would downvote but I'm stunlocked with +10 Emotional Damage from finding out Numa has reached the 20 year mark.

  • @JeffGeerling

    @JeffGeerling

    21 күн бұрын

    Half a lifetime ago... :O

  • @gipilot1
    @gipilot116 күн бұрын

    NUMA NUMA! *Quick Dance Break* I would love to see, if these patches would affect the non-pi SBCs with the same performance and power efficiency improvements.

  • @JohnSmithYoutube
    @JohnSmithYoutube23 күн бұрын

    Ooh first! I've been into Rasperry Pi for a while but the only NUMA I've ever heard of isn't computing related 😂 Love your videos, Jeff

  • @trmazi
    @trmazi22 күн бұрын

    NUMA NUMA!

  • @iam.jasonhoward
    @iam.jasonhoward23 күн бұрын

    💯

  • @coolergappney1943
    @coolergappney194322 күн бұрын

    The numa numa guy recently re- made his video from way back

  • @ZupaMolo
    @ZupaMolo21 күн бұрын

    AHA GREAT BLOOPERS

  • @untoldtitan
    @untoldtitan23 күн бұрын

    Numa Numa ftw

  • @caspianmaclean8122
    @caspianmaclean812222 күн бұрын

    Idle power saving could help battery life on pi-based handheld consoles.

  • @SP-ny1fk
    @SP-ny1fk22 күн бұрын

    Numa numa eh numa numa numa eh

  • @owenness6146
    @owenness614623 күн бұрын

    Numa Numa

  • @timvanrooyen
    @timvanrooyen22 күн бұрын

    oh there’s a mouse behind the cup

  • @mikk150
    @mikk15022 күн бұрын

    Numa Numa yei

  • @alexanderwingeskog758
    @alexanderwingeskog75823 күн бұрын

    Wow the sleep state thing, just bought another Pi Zero 2 W that I have connected to a small battery (7.2 AH) and 30W smallish solar panel (with charger) to see if it (I don't have that much sun where I live) could "run" forever :-) and that would be awesome with even less power if not doing much work... But then again, I was thinking of making do something that will probably not let it into any kind of power saving mode anyway...

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    Yeah a lot of times the sleep states are less useful for use cases where you would use a Pi-but still nice to have available nonetheless. I've started using Picos in some places where I used to use Pis, and even there, I think it would be nice to have better 'sleep'/idle support.

  • @michaelweichhardt
    @michaelweichhardt14 күн бұрын

    Giga Flaps

  • @MarcoGPUtuber
    @MarcoGPUtuber23 күн бұрын

    Numa Numa? Is this the advent of Dragostea Din Geerling?

  • @Daily_Bugler
    @Daily_Bugler23 күн бұрын

    Haha you viewed The Register website… Thats Jiffy on a watch list…

  • @AmeOFF
    @AmeOFF23 күн бұрын

    lol the thumbnail

  • @Ironic-Social-Phobia
    @Ironic-Social-Phobia23 күн бұрын

    The outro needs the TC background music...

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    Haha, I always hear it in my head while I'm editing that bit.

  • @miarosa
    @miarosa23 күн бұрын

    "numa numa" as asked in the video

  • @KernelFault
    @KernelFault23 күн бұрын

    A red light next to your camera that turns on with the HVAC might be helpful.

  • @JeffGeerling

    @JeffGeerling

    23 күн бұрын

    I actually have most of it in Home Assistant, I just haven't had the time to wire up an automation for 'recording' that works for me. I can't just trigger it on the studio lights because sometimes I have those on when I'm not recording a video. And I'm still working on better automation for my recording / saving video files off the camera.

  • @michaelcummings7246

    @michaelcummings7246

    22 күн бұрын

    ​@@JeffGeerlinganother thing to keep in mind is at least 90% of your viewers are in rooms with fans etc or other places with more than 40dB background noise and wouldn't even notice it as much as you do during editing 😉

  • @JeffGeerling

    @JeffGeerling

    22 күн бұрын

    @@michaelcummings7246 Heh, true-but the rumble is annoying because of the frequency, and my HVAC unit also seems to not play nice with AI noise removal, making for some weird audio if I try removing it in post. Easier to just not have it going!

Келесі