Can SRAM Keep Shrinking?

Links:
- The Asianometry Newsletter: www.asianometry.com
- Patreon: / asianometry
- Threads: www.threads.net/@asianometry
- Twitter: / asianometry

Пікірлер: 413

  • @wesleyw.terpstra1902
    @wesleyw.terpstra19023 ай бұрын

    "It can draw out data in a few nanoseconds." No. SRAM can draw out data in fractions of a nanosecond. In 3nm-7nm, small, even stock TSMC SRAMs (use in an L1) can manage 250ps clock to data. Larger macros (used in an L3) can still achieve

  • @Fiercesoulking

    @Fiercesoulking

    3 ай бұрын

    To be precise it depends on the CPU clock speed and how many bytes per design are read/write at once. Yes nano seconds are DDR ram not SDRAM

  • @wesleyw.terpstra1902

    @wesleyw.terpstra1902

    3 ай бұрын

    @@Fiercesoulking Not really. SRAM timing is unrelated to CPU frequency, other than that some macros may happen to run on the same clock. PVT corner and geometry dictate the clock to data time.

  • @vitalyl1327

    @vitalyl1327

    3 ай бұрын

    ​@@Fiercesoulkingit is common to use 2x clock on SRAM blocks to simulate dual port access

  • @lbgstzockt8493

    @lbgstzockt8493

    3 ай бұрын

    That’s insane. Light barely travels across the entire CPU during that time, yet we read data in that timespan.

  • @Gameboygenius

    @Gameboygenius

    3 ай бұрын

    ​@@lbgstzockt8493"the entire CPU" is absolutely huge compared to the size of a SRAM cell. Like comparing walking across the block to circling Earth.

  • @davidt-rex2062
    @davidt-rex20623 ай бұрын

    Never had a transistor compared to yeast before. It's these kinds of analogies that Im here for.

  • @michaelmoorrees3585

    @michaelmoorrees3585

    3 ай бұрын

    That's before the transistor got as small as yeast ... Well, transistor shrank to yeast size back in the 1980s. A couple of orders of magnitude smaller, now.

  • @rashidisw

    @rashidisw

    3 ай бұрын

    The research need another direction too. Rather than focusing on increasingly more difficult how to prevent quantum tunneling from happening, we should open up the study on how to utilizes the quantum tunneling effects to achieves better reliability & performances.

  • @Kaizzer
    @Kaizzer3 ай бұрын

    «More memory is as good as I remember» ~ Asianometry, 2024

  • @clintcowan9424

    @clintcowan9424

    3 ай бұрын

    Write that down 😂

  • @BlueRice

    @BlueRice

    3 ай бұрын

    Nor always true. It depends in application. Some benefits - overall system. There are application that benefits in ram speed ;most importantly timing. Cache on cpu does just that. Repetitive task that used the same memory benefits it on cpu Cache. Cpu higher clock does not always make things faster when Cache bottle neck it.

  • @msimon6808

    @msimon6808

    3 ай бұрын

    @@clintcowan9424 Sent it to friends and family

  • @MikkoRantalainen

    @MikkoRantalainen

    3 ай бұрын

    I think he could have continued, "... though I don't remember anybody ever saying that".

  • @impulsiveDecider

    @impulsiveDecider

    3 ай бұрын

    ​@@BlueRiceNot only repetitive, just everything that follows locality

  • @GegoXaren
    @GegoXaren3 ай бұрын

    AMD said that using anything lower than 5N for large SRAM blocks _costs more than they taste_ (as we say in Sweden).

  • @EyesOfByes

    @EyesOfByes

    3 ай бұрын

    And dont forget "Costs shirt" ;) Mvh Ajsof-bajs 💩

  • @peteblazar5515

    @peteblazar5515

    3 ай бұрын

    No. That's what a customer paying for Epyc-X said.

  • @AK-vx4dy

    @AK-vx4dy

    3 ай бұрын

    For L3 is quite sensible, but L1 is no go

  • @johndoh5182

    @johndoh5182

    3 ай бұрын

    Yes and no. Actually the shrink in size starts to become neglegable at the 7nm node, but AMD will use 6nm, a variant of 7nm for die that is say, L3 cache. This is using TSMC, other companies nodes are different. Inside a core there is no choice but to use the node the core is on because certain cache HAS to be built into the core, which is true with L1 and L2. L3 is also built into the core but it's pushed further away, and using interposers you can join one die to another and put L3 cache elsewhere. AMD has X3D CPU parts that have L3 on both the core die and another die that stacked onto the core. I could see a day when AMD moves to what Intel is starting to do now (Meteor Lake) and have chiplets that connect directly together instead of having to send data to what they call Infinity Fabric which has to multiplex data to send it to the right place, which is how AMD connects core die (CCD) to each other along with to an I/O die (IOD). If this happens then instead of stacking die, AMD could make an L3 chiplet that sits next to the core die(s). At which point AMD and Intel both could push ALL L3 onto another die.

  • @herrbonk3635

    @herrbonk3635

    3 ай бұрын

    What does 5N mean? Five nanometer?

  • @vk3fbab
    @vk3fbab3 ай бұрын

    As said in the video we're at a point where all of the challenges are starting to dominate. Lower voltages means reduced noise margins. Smaller feature sizes increase tunneling effects and requirements for even higher precision lithography. We'll probably overcome these but it will be slow going and more revolutionary than someone coming out and saying we've solved them all. We also have opportunities to try new computing architectures to try and avoid some of the short comings. We have a history of hitting a roadblock and coming up with clever solutions that nobody saw coming.

  • @paulmichaelfreedman8334

    @paulmichaelfreedman8334

    3 ай бұрын

    This is something a well-trained AI could tackle. Meaning it could analyze possible solutions given as input, much deeper than any human could.

  • @Napoleonic_S

    @Napoleonic_S

    3 ай бұрын

    @@paulmichaelfreedman8334 not really, AI can't invent new magic physics...

  • @lt2660

    @lt2660

    3 ай бұрын

    ​@@paulmichaelfreedman8334definitely not. Our ai is basically just pattern recognition, it doesnt function like a human brain that thinks. If it gave us a solution, it would either be copying a human or 'hallucinating' and accidentally giving a solution

  • @paulmichaelfreedman8334

    @paulmichaelfreedman8334

    3 ай бұрын

    @lt2660 My apologies, I meant AGI/ASI

  • @paulmichaelfreedman8334

    @paulmichaelfreedman8334

    3 ай бұрын

    @@Napoleonic_S I never implied that, I implied it could do a much deeper analysis of (human conjured) theories. And I also should have said AGI/ASI

  • @xemorr
    @xemorr3 ай бұрын

    My lecturer at the university of cambridge recommended your video! I was already a fan but was surprised to hear a recommendation in one of my lectures

  • @kodeinBytes
    @kodeinBytes3 ай бұрын

    I love the jokes you throw from nowhere, pure silicon comedy

  • @TheRoulette77

    @TheRoulette77

    3 ай бұрын

    ya his humor is very glassy

  • @kuronyaa-san

    @kuronyaa-san

    3 ай бұрын

    Sillycom. Get it? Sillycom... Bad joke. Bad!

  • @user-ro1cc8tz6d

    @user-ro1cc8tz6d

    3 ай бұрын

    🤓

  • @danielthecake8617

    @danielthecake8617

    2 ай бұрын

    He's very sili and conedic

  • @tamasmihaly1
    @tamasmihaly13 ай бұрын

    "...Just kidding, nobody says that..." Your jokes are improving. That was good.

  • @sagetmaster4
    @sagetmaster43 ай бұрын

    The progress within the semiconductor industry is an example of what can happen when people have a shared goal and actually choose to be effective and pragmatic about finding solutions, not that it's flawless, just better than almost every other human project

  • @gteixeira

    @gteixeira

    3 ай бұрын

    It is because there are companies all over the world competing neck to neck and have to make the best products to stay in the market. In pretty much anything else companies compare neck to neck to monopolize their respective markets and not bother to bring any better products after that.

  • @sznikers

    @sznikers

    3 ай бұрын

    Member how bad it was when AMD nearly flipped due to bulldozer fiasco and Intel fed us 4core CPUs with 2% perf increments for years?

  • @alquinn8576

    @alquinn8576

    3 ай бұрын

    i wonder if TSMC and Samsung emails have employee pronouns in their emails. i'm going to guess not!

  • @gteixeira

    @gteixeira

    3 ай бұрын

    @@alquinn8576 I've worked with a company that works with TSMC. No, they don't. Almost no one in the semiconductor industry does.

  • @user-cc32vcg811

    @user-cc32vcg811

    3 ай бұрын

    ​@@alquinn8576Taiwan is proly the most lgbtfriendly nation on asia

  • @Shinzon23
    @Shinzon233 ай бұрын

    I love how we are getting so small that quantum mechanics is required to do anything more...or how it's been making it impossible to squeeze more performance out.

  • @paulmichaelfreedman8334

    @paulmichaelfreedman8334

    3 ай бұрын

    Yes, it's ridiculous really, how far we've come technologically in the last 120 years.

  • @thomasachee463

    @thomasachee463

    3 ай бұрын

    We've been there for a while!

  • @deang5622

    @deang5622

    3 ай бұрын

    Technically we have been employing quantum mechanics on every transistor regardless of how small it is.

  • @thewheelieguy

    @thewheelieguy

    3 ай бұрын

    @deang5622 I have to disagree: by the end of the 1800s we had quite enough understanding of crystals, atoms and electrons that a scientist of the day could understand how a diode functions and eventually a transistor. Classical physics is certainly enough to understand what's going on.

  • @effexon

    @effexon

    3 ай бұрын

    @@thewheelieguydid I understand correctly, scientists still are just trying to avoid quantum things (eg tunneling ) and build chips according to these classical physics laws... it just gets complicated design having billions of these simple transistors in one chip.

  • @BobDiaz123
    @BobDiaz1233 ай бұрын

    All this takes me back to the early 1970s when we were shocked that manufacturers could put 1024 bits of static RAM on a single chip. Moore's Law has been one heck of a ride.

  • @msimon6808

    @msimon6808

    3 ай бұрын

    Popular Electronics January 1975 was my start in computer electronics. Heck of a ride - I designed the IO board used in the World's First BBS. And now look at what has happened.

  • @kurrdelacruz
    @kurrdelacruz3 ай бұрын

    12:45 the saying goes: CACHE RULES EVERYTHING AROUND ME

  • @pseudo_goose

    @pseudo_goose

    3 ай бұрын

    data data bytes yall

  • @wesleyw.terpstra1902
    @wesleyw.terpstra19023 ай бұрын

    90%+ SRAM is certainly a lot, but having a lot of SRAM on a chip has a lot of benefits. For one, while it leaks, it consumes a lot less power than logic. It's also super regular and hand-crafted (unlike most logic), so, in a way, it's a very efficient use of area (especially compared to registers). It also has low power states you can use to save power in a graduated manner. Hotspots are basically always places where you don't have enough SRAM. Designers go out of their way to try to turn structures that use registers into a structure that can use an SRAM for these benefits. The real difficulty is that to get the best density, you need to use 1RW-ported SRAM macros, which puts real limits on how you can use them. Nonetheless, this trade-off is almost always worthwhile.

  • @alphar9539

    @alphar9539

    3 ай бұрын

    SRAM that’s stacked runs hot and is often the hottest part of the SoC.

  • @wesleyw.terpstra1902

    @wesleyw.terpstra1902

    3 ай бұрын

    @@alphar9539 Sure. Anything stacked gets hot. 🙂

  • @jimgolab536

    @jimgolab536

    3 ай бұрын

    One other advantage of SRAM over random logic is that it is MUCH easier to test (also including self-test in the field).

  • @musaran2

    @musaran2

    3 ай бұрын

    Aren't registers made of the same transistors as (on-chip) SRAM? Do you mean separate chip SRAM? That registers are intertwined with logic thus of more expensive design? Or just less optimized because less regular?

  • @wesleyw.terpstra1902

    @wesleyw.terpstra1902

    3 ай бұрын

    @@musaran2 Yes they are both made by the same process, but the transistors in the SRAM (and the fabric to read/write from the port) are super optimized because they are so regular and well understood. My understanding (I just use these macros; I don't design them) is that normal registers need to be built more conservatively for DRC, toggle more often, and have irregular control wiring.

  • @BarsMonster
    @BarsMonster3 ай бұрын

    Very interesting video ! And thanks for attribution ) I get a bit of a deja-vu every time I see my photos, but this gets cleared as I read the text below :-)

  • @jslonisch
    @jslonisch3 ай бұрын

    I saw the video caption and thought “I know Shimano are dominant but I didn’t think it was that bad”. 😂

  • @garymartin9777

    @garymartin9777

    3 ай бұрын

    go ride a bike !!

  • @aderinolamiju

    @aderinolamiju

    3 ай бұрын

    same 😂

  • @Sir_Uncle_Ned
    @Sir_Uncle_Ned3 ай бұрын

    The simple fact that we are reliably working on such small scales that the size where quantum tunneling becomes a problem is considered outdated and quaint boggles my mind.

  • @kunjs
    @kunjs3 ай бұрын

    have been so asianometry-pilled that I actually appreciate your "dram" joke.

  • @soy_leche
    @soy_leche3 ай бұрын

    I thought you mean SRAM the bike component company! My hobby/interests have collided

  • @patrickglaser1560

    @patrickglaser1560

    3 ай бұрын

    More of a shimano guy but sram is good too

  • @escgoogle3865

    @escgoogle3865

    3 ай бұрын

    Gen two Campy ergo is my fav. 11clicks of triple crank goodness on the left shifter and they just fit my hands@@patrickglaser1560

  • @NJ-wb1cz

    @NJ-wb1cz

    3 ай бұрын

    Yeah, "end of SRAM" made my heart sink

  • @Asdayasman

    @Asdayasman

    3 ай бұрын

    Crashing a bike into a silicon wafer would be very expensive.

  • @johndoh5182
    @johndoh51823 ай бұрын

    So, another word for a latch is a flip flop. but latches/flip flops come in many forms. This is a VERY basic latch, the minimal transistors needed to retain a state of a 0 or a 1. If you were to look at a logic gate breakdown of this latch it's VERY easy to make sense of it. Looking at a transistor breakdown, you have to understand the transistors. You have in effect two sides for a latch. Each side outputs the opposite of each other. So, if one side is outputting a low (can't use 0 or 1 here) voltage, the other is outputting a high. You can also say there is one side that has a true output and the other is false, or say one side is low when true, and the other side is high when true. So, if a 1 is stored in that latch then one side is low = true and the other side is high = true. If a 0 is stored, those two signals are inverse. So, the high = true output would be low = false. The way a latch works is the output of each side feeds back to the input of the other side, creating a loop that locks that logic state in the absence of another input. Data will come in on one side of the latch. If the data (0 or 1) is the same, the latch stays in the same state, if it's different, the latch changes state. This is a very simple thing. This is basic digital logic. The reason why this is used is because you can switch transistors WAY faster than switching anything else. You can switch the state of this latch at the clock speed that the CPU is running at.

  • @slicer95

    @slicer95

    3 ай бұрын

    This is incorrect. Latches and flip flops are different. Latches are level sensitive, flip flops are edge sensitive. A good chunk of money has been lost while designing a chip when someone accidentally put latches instead of flip flops.

  • @cube2fox

    @cube2fox

    3 ай бұрын

    Wikipedia: > The term flip-flop has historically referred generically to both level-triggered (asynchronous, transparent, or opaque) and edge-triggered (synchronous, or clocked) circuits that store a single bit of data using gates.[1] Modern authors reserve the term flip-flop exclusively for edge-triggered storage elements and latches for level-triggered ones.[2][3]

  • @dougabugg
    @dougabugg3 ай бұрын

    I love those images you found of the grid of SRAM cells; the pattern is so mesmerizing to stare at, some reminded me of pictures DNA/chromosomes

  • @weedmanwestvancouverbc9266

    @weedmanwestvancouverbc9266

    3 ай бұрын

    A geometric order, an insulated border.

  • @paulrowlett171
    @paulrowlett1713 ай бұрын

    Am I the only one who came here thinking Shimano had finally achieved total dominance?

  • @EyesOfByes
    @EyesOfByes3 ай бұрын

    1:52 RIP 3DXpoint. We hardly new ye

  • @wile123456
    @wile1234563 ай бұрын

    Production quality has gone up. The background is soothing, gives me PS3 music visualizer vibes

  • @tulsatrash
    @tulsatrash3 ай бұрын

    I am going to start using "more memory is as good as I remember" and "more memory.is better than I remember".

  • @lilblackduc7312

    @lilblackduc7312

    3 ай бұрын

    At the age of 65yrs old, I agree!

  • @thewheelieguy
    @thewheelieguy3 ай бұрын

    You should make the point that SRAM in a processor is present in large amounts because it's used in caches , not being used as generally addressed working store, except for some embedded SOC applications. Also, SRAM is made with a standard "Logic Gate" fab process and DRAM uses very different materials and layering.

  • @cube2fox

    @cube2fox

    3 ай бұрын

    From what I understand SRAM is both used in registers and larger caches. I don't know why the distinction though.

  • @sdstorm
    @sdstorm3 ай бұрын

    "Like its cousin dhram, S-ram is..." Smooth.

  • @TheBlackIdentety
    @TheBlackIdentety3 ай бұрын

    Very informative and well put together as always. Tell us about possible alternative solutions in a future video please!

  • @ikarosav
    @ikarosav6 ай бұрын

    great vid! imec had a very neat vertical nanowire fet sram cell design that from my armchair seemed to take advantage of the novel way that xtor design interconnects with one another

  • @Tandanuu

    @Tandanuu

    3 ай бұрын

    You commented 2 months ago?

  • @TSAlpha2933

    @TSAlpha2933

    3 ай бұрын

    patreon's a thing ​@@Tandanuu

  • @lilguyfinish

    @lilguyfinish

    3 ай бұрын

    Stop using your quantum private network to connect to events in the future ikarosav. This is supposed to be an under-the-table project...

  • @JoaoPedro-ki7ct

    @JoaoPedro-ki7ct

    3 ай бұрын

    @@Tandanuu 0:59 Likely

  • @lbgstzockt8493

    @lbgstzockt8493

    3 ай бұрын

    "Patreon supporters get early access to videos"@@Tandanuu

  • @boots7859
    @boots78593 ай бұрын

    Would be interesting to see a video on alternatives to Si. Its always been a side-niche as Si has always been either further shinkable or amenable to assists from things like straining or copper/cobalt interconnects. 3D stacking advances will add life, as are photonics. Alternatives show at least some advance over Si, Cubic boron arsenide, molybdenum disulfide, GaN, CNT, Graphine, Organic Electronics....

  • @uditkotnis7531
    @uditkotnis75313 ай бұрын

    Thanks for the citations, they are invaluable.

  • @NSUGS
    @NSUGS3 ай бұрын

    As a bicyclist, I was confused by the title. Now I have more questions

  • @Arowx
    @Arowx3 ай бұрын

    What about instead of trying to get the data/memory to work on smaller and smaller chips you put the processors on all the memory chips. Instead of a Von Neuman Central Processor Unit with external memory storage we adopt a Central Memory Unit with external processing chips on a super fast bus.

  • @slawissimo
    @slawissimoАй бұрын

    It's great content. I love your channel and it allowed me to learn A LOT about semiconductors, technology. I've started to learn how to program microcontrollers. BUT. I'm also watching ot from Poland. And SRAM in polish - when considered a word means - "I'm making poop" but not in polite way and then title "Can SRAM keep shrinking is REALLY FUNNY

  • @Estrav.Krastvich
    @Estrav.Krastvich3 ай бұрын

    Man, you are cool! Thanks for all deep tech videos you make.

  • @kaspakas
    @kaspakas3 ай бұрын

    "more memories as far as I remember" is a perfect 10/10 memorable

  • @lucasrem
    @lucasrem3 ай бұрын

    My solution was always more level 1 SRAM, 80% of the Soc, wow. Keep innovating what we use is the solution here.

  • @IOFLOOD
    @IOFLOOD3 ай бұрын

    It makes sense to use older nodes for SRAM stacked on newer process node logic chips. The cost would be pretty good as older nodes demand drops off and the equipment gets amortized. Apple's integrated HBM is also a good solution as making the ram faster puts less pressure to need the even faster caches to be quite so big. Everything is a tradeoff and there are some reasonable tradeoffs to choose from.

  • @cube2fox

    @cube2fox

    3 ай бұрын

    Yeah, but that means cost wouldn't decrease any further in the future. In the past cost per bit decreased with each node shrink.

  • @IOFLOOD

    @IOFLOOD

    3 ай бұрын

    @@cube2fox certainly it becomes challenging to reduce cost of sram from here forwards regardless what strategy is used. However, if a fixed node size becomes standard for sram, you can reduce costs in two major ways. One, you can optimize the cost of producing and operating lithography at the "final" process node. Two, due to stable demand for the process node, you can amortize the investment in plant and equipment over a longer time period. Not nearly as good as Moore's law, but it's not nothing.

  • @exklimexklim
    @exklimexklim3 ай бұрын

    I love this channel as much as my 2mb L3 cache.

  • @hinz1
    @hinz13 ай бұрын

    DRAM is just horrible for fast access, low latency stuff, thereby it will never die for registers, fast cache, non static FPGA LUTs..... For slow stuff such as slow memory, it's long dead already, except for small microcontrollers or special applications, like non volatile RAM.

  • @fungo6631

    @fungo6631

    3 ай бұрын

    eDRAM is quite a bit faster though.

  • @volodumurkalunyak4651

    @volodumurkalunyak4651

    3 ай бұрын

    @@fungo6631 aren't tRCD with tCL still in 10s of ns for eDRAM?

  • @fungo6631

    @fungo6631

    3 ай бұрын

    @@volodumurkalunyak4651 I dunno, the Gamecube and Wii's eDRAM had a 5 ns latency.

  • @FuzTheCat
    @FuzTheCat3 ай бұрын

    More memory is as good as I remember ... very memorable!

  • @micgalovic
    @micgalovic3 ай бұрын

    Shimano will be happy about this

  • @williamhoodtn
    @williamhoodtn3 ай бұрын

    Pronounced perfectly: S-RAM. Now do the same for DRAM as in D-RAM.

  • @AC-jk8wq

    @AC-jk8wq

    3 ай бұрын

    A foolish consistency… is the hobgoblin of little minds…. - Ralph Waldo Emerson 😃 We’ll all be back next week to watch Jon cover the next topic… pronounced any way he so desires….

  • @jimgolab536

    @jimgolab536

    3 ай бұрын

    I have to agree. All of us nerds in my nerd world (including my being an actual SRAM chip designer in a dram/sram/rom design group back in the Stone Age) called it DEE-RAM, not dram.

  • @AlexKarasev
    @AlexKarasev3 ай бұрын

    I read the thumbnail as "THE END OF SPAM" and was like, gosh, there's light at the end of the tunnel after all!

  • @Gameboygenius

    @Gameboygenius

    3 ай бұрын

    The end of the quantum tunnel.

  • @EpicGamer-ux1tu
    @EpicGamer-ux1tu3 ай бұрын

    Really interesting, thanks for the video.

  • @AK-vx4dy
    @AK-vx4dy3 ай бұрын

    How dare you ;) Bi-stable latch is a pinnacle of logic circuits...

  • @MichaelDeHaven

    @MichaelDeHaven

    3 ай бұрын

    And very well named too.

  • @AaronSchwarz42
    @AaronSchwarz423 ай бұрын

    Apple M3 M4 M5 & further show SOC emerging efficient compute since all IC parts so close, faster while using way less energy

  • @AndrewMellor-darkphoton
    @AndrewMellor-darkphoton3 ай бұрын

    Heard TSMC can increase the sram density if they remove all logic. Not sure how that works though.

  • @kazedcat

    @kazedcat

    3 ай бұрын

    Removing all logic removes a lot of noise these allows higher density. The thing with SRAM is that it is partially analog. The two bitline does not only carry data but they also serves a function when reading and writing. When you have logic that is very noisy the bitlines are giant antenna that might flip the state of the SRAM cell.

  • @andersjjensen

    @andersjjensen

    3 ай бұрын

    That is exactly how AMD's 3D-Vcache works. There is nothing but SRAM on the chiplet (and of cause the connecting pins) so the gate patterning can be optimized solely for that layout.

  • @musaran2

    @musaran2

    3 ай бұрын

    As a general rules, chip processes are optimized for either speed (logic), density (memory) or efficiency (mobile/embedded). Mixing on a chip means compromising, though some tricks allow to tune transistors on the same chip.

  • @chrimony
    @chrimony3 ай бұрын

    The reason the chip is filled with 90+ percent of SRAM is because it's the most efficient thing to do when you run out of things to use the logic circuits for. Nobody said they had to put that SRAM in there, they could just leave it out. But large on-die cache is very good for performance, because main memory is many times slower. But I think the rise of GPU shows there's room to grow the number of parallel cores.

  • @andersjjensen

    @andersjjensen

    3 ай бұрын

    The problem is that most things that are highly parallel problems by nature have all been moved to the GPU by now. I can personally use as many cores as I can get because software compilation is one of the few problems that are highly parallel but also highly branched, which GPUs suck at. But mostly everyone else, outside of scientific modelling and whatnot, don't need more cores. They need faster cores.

  • @chrimony

    @chrimony

    3 ай бұрын

    ​@@andersjjensen Faster cores have been stalled for almost two decades. It was quite the ride up until the early 2000s -- exponential increases every couple of years. Back in the late 90s I was going to wait for a computer upgrade until they got to 10GHz clock rate. Still waiting...

  • @andersjjensen

    @andersjjensen

    3 ай бұрын

    @@chrimony Clock rate is nothing, IPC (Instructions Per Clock) is everything. My 7950X3D does more than twice the work per clock tick than my 2700X did on a per-core basis. So no, we are not getting twice as fast cores every two years, but heck that ride was already over by by the Pentium 2. But I absolutely wouldn't call it "stalled". Sure, Intel were eating their crayons and sniffing their glue for 7-8 years stright because they fumbled hard and couldn't get off 14nm, but these days 25-30% better per-core performance each generation is normal.

  • @chrimony

    @chrimony

    3 ай бұрын

    @@andersjjensen Clock rate is not "nothing". While it can be abused/misused, a generic CPU from the 66MHz era is never going to outperform a 1GHz generic CPU, regardless of the architecture. It would have been really nice if clock speeds had kept scaling at the pace of transistor counts. Those days were insane, and it went on for decades. Quite the wonderful run. Gains are still happening, and there have been benefits like reduced power-usage, but the free lunch is over.

  • @LiLBitsDK

    @LiLBitsDK

    3 ай бұрын

    @@chrimony it was a fun time to be alive for sure

  • @justindressler5992
    @justindressler59923 ай бұрын

    Thanks for this analysis it provides a vary clear explanation of the challenges in modern chip design. I wonder if stacked cache has trade offs as well such as latency, being further away from the logic core. We seem to be at the limit now with 5nm too be honest this is better than I expected I remember telling a co-worker 10 years ago 7nm would be the limit. These multi pattern designs may allow us to get smaller but at substantially lower yields and higher costs. This is I guess why cutting edge tech is getting more expensive.

  • @musaran2

    @musaran2

    3 ай бұрын

    A stacked chip can be closer than most surface of an on-chip cache. The problems is the chip-to-chip vias use much more space than in-chip lines. It uses footprint, it constrains line placement and spacing, and it requires stronger electric drive.

  • @justindressler5992

    @justindressler5992

    3 ай бұрын

    @@musaran2 cool makes sense

  • @fredcrayon
    @fredcrayon3 ай бұрын

    “You are my density” -George McFly

  • @MarekKnapek
    @MarekKnapek3 ай бұрын

    "We will need more alternative solutions." Yeah, like write computer programs in languages such as C, C++, D, Zig, Rust instead of freaking Electron (JavaScript) on desktop or freaking Node (again, JavaScript) on server. Here, free performance boost without changing nanometers or dealing with quantum tunneling.

  • @dale116dot7

    @dale116dot7

    3 ай бұрын

    Or my favourite language… assembly. When it’s hard to write you write it efficiently. Straight ahead C is pretty good, C++ is very inefficient comparatively, and uses a lot more RAM, especially on run-in-place embedded systems where code runs straight from flash and not RAM. I design car ECUs and that’s how they work.

  • @fungo6631

    @fungo6631

    3 ай бұрын

    But that means you'll need to get rid of web dev diversity hire that got the job for all but their skills.

  • @cj09beira

    @cj09beira

    3 ай бұрын

    @@fungo6631 oh, no anyways... 😂

  • @AchmadBadra

    @AchmadBadra

    2 ай бұрын

    I just remembering when they say c# and java is bloated, but hey they just choose a more bloated solution : web browser, with killing flash, silverlight, and then reintroduced similar solution : web assembly. I just smelling a political reason to those trend. Another example, google and jpeg xl, google still insist to force everyone to accept webp and avif as de facto a replacement for jpeg and png.

  • @marisakirisame867
    @marisakirisame8673 ай бұрын

    Im always thinking that if the nodes keeps getting smaller, the chances to it being harmed is higher ( and even those lil bacteria might can crack it )

  • @andymouse
    @andymouse3 ай бұрын

    Cheer up buddy ! The RAM will get sorted some how...cheers !

  • @p_mouse8676

    @p_mouse8676

    3 ай бұрын

    Cheese!

  • @WaterZer0
    @WaterZer03 ай бұрын

    I actually felt like I knew something for once when I knew the solutions immediately: stacking and gate-all-around.

  • @systemBuilder
    @systemBuilder3 ай бұрын

    Dont forget that the internet is level 7 in the memory hierarchy ..

  • @Mavendow
    @Mavendow3 ай бұрын

    Shrinking a transistor by half means it has √s̅u̅r̅fa̅c̅e̅a̅r̅e̅a̅, so this results in more than 50% faster electron traversal. However, we only see 20-40% improvement because of efficiency loss. This means that a slowing ability to shrink the size of the transistor is expected; we're getting _more_ than double the theoretical cap every time the transistor shrinks by half.

  • @spladam3845
    @spladam38453 ай бұрын

    Fantastic as always.

  • @lukapucek3668
    @lukapucek36683 ай бұрын

    Great video!

  • @mrflamewars
    @mrflamewars3 ай бұрын

    One of the worst examples I've personally owned of "Most of the chip is cache" is the Pentium M Dothan - the 2nd version of the P-M with 2MB cache. It's kind of obscene looking.

  • @VasilisMichRavenclaw
    @VasilisMichRavenclaw3 ай бұрын

    With all this discourse around memory, could you please do a video on memristors? It looks like a technology that should not be slept on and I think we'd all value your opinion on the matter.

  • @ryanshea5221
    @ryanshea52213 ай бұрын

    I'm happy improvement has slowed down. Maybe now companies will be forced to actually pay attention to optimization and web devs will have to learn how memory works

  • @MetroidChild
    @MetroidChild3 ай бұрын

    Also something to mention is that actually moving the data to and from ever larger caches requires infrastructure, infrastructure which increases the total power draw and latency.

  • @st.john_one
    @st.john_one3 ай бұрын

    interesting like almost ;) every topic on this fantastic channel :) greetings to aaaall of you :*

  • @gamerpaddy
    @gamerpaddy3 ай бұрын

    since the active layer on a silicon chip is just a few layers and nanometers thick, they could go more vertical like 3d nand. theres plenty of vertical room

  • @alphar9539

    @alphar9539

    3 ай бұрын

    Except the heat concentrates then and bakes the interior SRAM. It is a solution, but not a long term solution.

  • @MapSpawn
    @MapSpawn3 ай бұрын

    Great video, thank you.

  • @lexer_
    @lexer_3 ай бұрын

    I still enjoyed the video but I kind of feel like I missed the part about why sram shrinkage is a problem with the current cutting edge nodes in particular. I certainly understand better the core tradeoffs and issues with sram cell design but which part of that is the problem with for example 3nm? Is the answer essentially we don't know because tsmc is being tight lipped about the exact details so we can only make more general conclusions?

  • @lexer_

    @lexer_

    3 ай бұрын

    Ah, I think I can answer my own question after watching it again. It's a question of yield. Denser SRAM causes yields to drop below an acceptable limit to be commertially viable.

  • @alphar9539

    @alphar9539

    3 ай бұрын

    @@lexer_ SRAM has not scaled in roughly a decade. Now it isn’t even shrinking at all. So we are going 3d and stacking. But that’s expensive and runs into heat issues. Like a hot sandwich where the meat gets extra cooked

  • @raylopez99
    @raylopez993 ай бұрын

    I didn't know SRAM doesn't use capacitors but a series of flip-flops that input into each other to create a bi-stable state, interesting.

  • @n00b247
    @n00b2473 ай бұрын

    SRAM profit margins are the lowest in the industry. Safe bet it they will up the price and pace the supplies.

  • @fungo6631

    @fungo6631

    3 ай бұрын

    And perhaps that will finally mean the end of incompetent web development diversity hire as people will be forced to optimize their code better.

  • @lidarman2
    @lidarman23 ай бұрын

    For a moment I thought this was about the bike components company.

  • @torginus
    @torginus3 ай бұрын

    I wonder if SRAM can be produced with much greater defect tolerance as opposed to logic - I mean, after the fact, we can just run a test to see which cells are faulty, and burn in a hardware level mapping that shuts off faulty cells, with not having to deal with them.

  • @unfrostedpoptart

    @unfrostedpoptart

    Ай бұрын

    They've done this for many years.

  • @herrbonk3635
    @herrbonk36353 ай бұрын

    2:30 There was SRAM (Static Random Access Memory) long before 1963. Why not try to differentiate a little between that and integrated SRAM...

  • @2kadrenojunkiegaming655
    @2kadrenojunkiegaming6553 ай бұрын

    2:32 what? are we just glossing over that like its no big deal or something? he legit just went hey mate lemme borrow your table for a bit imma make something revolutionary rq

  • @M0ToR
    @M0ToR3 ай бұрын

    this dude sounds like knows what he is talking about, but he really doesn’t, dram

  • @christerwiberg1
    @christerwiberg13 ай бұрын

    A bit worrying, if the development tackles off, and we still increase the compute demand with 25% year on year or more, I guess we will start using that level more electricity per year. Might be a real problem eventually

  • @matthewhall5571

    @matthewhall5571

    3 ай бұрын

    It already is a problem. Bitcoin was wasting so much power that China had to ban it. The big cloud providers use terrifying amounts of electricity.

  • @Martinit0

    @Martinit0

    3 ай бұрын

    Bro, we have 1kW per square meter coming from above in daytime.

  • @grandsome1

    @grandsome1

    3 ай бұрын

    Well given that semiconductor production shares a lot of the logistics of the solar panel production maybe we can fend of that problem for a few years.

  • @escgoogle3865
    @escgoogle38653 ай бұрын

    Wait... this is not about the cycling industry in Taiwan.

  • @jozsiolah1435
    @jozsiolah14353 ай бұрын

    To enable it, try copying Windows 3.1 and dos files from the memory to the micro sd card in about 500 mb quantity. When the copying is faster, you activated this little portion. That is one, why a card is called hc, xc. It acts as a coprocessor. It also acts as a sound processor or codec. The card has Physx, but it is separate. When the portion is active, the card becomes highly reliable. Good for managers who handle precious data.

  • @fungo6631

    @fungo6631

    3 ай бұрын

    What were you supposed to comment on? This doesn't seem like it.

  • @cj09beira

    @cj09beira

    3 ай бұрын

    @@fungo6631 seems like ai garbage to me.

  • @truvc
    @truvc2 ай бұрын

    I thought this was gonna be about SRAM vs Shimano 😂

  • @treyquattro
    @treyquattro3 ай бұрын

    jeez, I thought this was about a new bicycle groupset!

  • @johnr909

    @johnr909

    3 ай бұрын

    Me too!

  • @whyjay9959
    @whyjay99593 ай бұрын

    Could something like ReRam overtake on-die SRAM at some point? And I'm told AMD's V-Cache is more dense than equivalent on-die SRAM because the process is optimized for it instead of being also for logic?

  • @cube2fox

    @cube2fox

    3 ай бұрын

    ReRAM is probably far too slow and at best suited as an alternative for flash, not DRAM or even SRAM.

  • @OpreanMircea
    @OpreanMircea3 ай бұрын

    thanks for listening in my case

  • @MissMoffet19
    @MissMoffet193 ай бұрын

    Sram means "I'm shitting" in polish 😂

  • @Abu_Shawarib
    @Abu_Shawarib3 ай бұрын

    The Memory Wall is as strong as ever

  • @liquidpatriot4480
    @liquidpatriot44803 ай бұрын

    Stone age: 50,000+ years Bronze-iron age: 5,000+ years Industrial age: 150 years Computer age: 70 years Our modern age: 20 years (micro computer technology in every aspect of our lives). The acceleration of technology is incredible when compared to previous eras.

  • @cj09beira

    @cj09beira

    3 ай бұрын

    history isn't a linear progression, we just been lucky in the last 2 thousand or so years not to be thrown back in the dark ages, the sun could easily throw us there with a little sneeze.

  • @john-r-edge
    @john-r-edge3 ай бұрын

    Very confusing video title for those who are interested in bicycles - where SRAM is one of the main competitors to Shimano as manufacturers of group sets (eg gears, brakes, pedals, cranks, wheel hubs etc).

  • @user-rt2jc1ng8r
    @user-rt2jc1ng8r3 ай бұрын

    Danke!

  • @honor9lite1337
    @honor9lite13373 ай бұрын

    DRAM 😱😱😱

  • @mapp0v0
    @mapp0v03 ай бұрын

    Any thoughts on Weebit Nano and 4DS Memory ReRAM

  • @jamesmorton7881
    @jamesmorton78813 ай бұрын

    SEUs and feature size is an issue ? yes / no L1 and L2 cache really need EDAC to avoid CPU crashing. SDRAM FIT rate was about one event per megabit per month at Ground level. This was researched by IBM and others. 24/7 operation can be an issue.

  • @markosluga5797
    @markosluga57973 ай бұрын

    more cache = more cash

  • @tobiasd5235
    @tobiasd52353 ай бұрын

    In my opinion the future is on HBM Ram chips.

  • @maxheadrom3088
    @maxheadrom30883 ай бұрын

    You forgot magnetic core and drum memory!

  • @KingJellyfishII

    @KingJellyfishII

    3 ай бұрын

    and punchcards (add in the latency of a human punching them and filing them)

  • @jamesowens7148
    @jamesowens71483 ай бұрын

    Obmyślam nowy plan, wtedy kiedy SRAM!

  • @paul.a.clayton6640
    @paul.a.clayton66403 ай бұрын

    I thought backside power delivery was expected to help SRAM density.

  • @tsclly2377
    @tsclly23773 ай бұрын

    Coding is one of the big problems.. to much 'paranoia (hash checks, Hamming checks and engility registry loops.)... better to go more RISC and back to 16bit for many processes using more stable SRAM larger designs

  • @BenTrem42
    @BenTrem423 ай бұрын

    12:46 🙂

  • @destroyer2496
    @destroyer24963 ай бұрын

    CRAM video when?

  • @systemBuilder
    @systemBuilder3 ай бұрын

    Today i think 4-transistor SRAM cells are more common .. no nerd to waste the 2 extra transistors ...

  • @cpt_bill366
    @cpt_bill3663 ай бұрын

    Cache is king!

  • @jell_pl
    @jell_pl3 ай бұрын

    main memory then magnetic disks? how old are pictures which you are reusing?!?

  • @johndoh5182
    @johndoh51823 ай бұрын

    Your statement about AMD and cache is incomplete, so much so that people that don't understand how CPUs and cores work it can give the wrong impression. SRAM is used in cores for registers along with cache. Registers are a collection of latches just like SRAM is, although the configurations will be different. There aren't many registers compared to cache. Registers can NEVER be moved off the main core die, because they are integral to the operation of the core, you need data registers to do pretty much ANYTHING in a CPU core. Registers are temporary storage for instructions, and the registers are tied into the instruction logic. A very simple thing of A + B could mean getting data from memory to add together and storing an answer back in memory, or it could be these values are constants built into the instruction. In either case, it's data that can be put into registers and then add those registers together and load the answer back into another register. The very next instruction may need these values so having the data in registers means the next instruction doesn't have to call that data from memory again. So that's one thing. Registers are integral to the operation of instructions and that will NEVER move off the core die. The next thing is cache. You mentioned L3 cache, but unless a person understands how a CPU works there isn't enough information there to understand the implication. There are typically 3 levels of cache in a core (there are multiple cores in a CPU). L1, L2, L3. L1 is closest to the instruction logic and operates at the same speed. There is not much of it because it's the hardest to make PERFECT because it has to once again, operate at the speed of the core. There is next L2 cache which there is more of. The problem with having more cache is the time to search it takes longer, so the time to fetch from L2 is longer than L1. The time to pull data from L1 is a single clock cycle, the time for L2 varies based on the CPU type. L2 ALSO HAS to be on the core die, because it's a larger pool of data/instructions that the core has been using and may need again. L3 is the slowest, and also the largest set of cache. THIS is what can be pushed off onto another die, as long as the connections between those two die operate fast enough which is the key. Cache replicates what is in memory, but there's a small amount of cache and a large amount of memory. As a core needs data, if that data hasn't been accessed already it's either on disk or in RAM (main memory). If it's on disk, it will get loaded into memory first, then pulled into the core. It HAS to go into L1 to be used by the core. Caching methods vary so I will give A method of caching. There is only a small amount of L1 cache which runs at the speed of the instruction logic. There is also cache for instructions and cache for data. Instructions of course run incredibly fast, as in a VERY rough figure of about a billion a second. This varies because there are wait times so you can't simply take a clock speed and say there is one instruction per clock cycle. This is why I'm giving a VERY rough figure for this. But, say 1 billion a second. In that time period L1 will have been changed out millions of time because L1 doesn't store much. One way to deal with a caching scheme is when L1 is full and you need something that isn't in L1 (where all data and instructions are dealt with from), is take the data/instructions used the furthest back in time (so you need a time stamp for what's in cache) and push that down to L2. If L2 is full, then you take the data/instructions used furthest back in time and push it down to L3. As was said, L1 - L3 represents data/instructions that came out of main memory. You never need to update instructions since instructions don't change, but you do data, and since L1 - L3 can have updated values for data that's stored in memory, you also need to write this change back to main memory. So the key takeaway is L1 HAS to be right next to instruction logic and runs at the core speed and it holds data/instructions each in a separate space, and it HAS to be on the same die as the cores. L2 ALSO has to be on the same die as the cores because you often need to access data/instructions that you're already used but since L1 is small it got pushed down to L2. L3 is the ONLY cache you can push onto another die, AS LONG AS you can clock the connection between the two die fast enough.