Why next-gen chips separate Data & Power
Ғылым және технология
Backside Power Delivery promises huge efficiency and performance advantages for modern computer chips, but also changes the semiconductor manufacturing process. Let's go an a deep-dive into Intel's PowerVia technology.
Become a supporter on Patreon: www.patreon.com/user?u=46978634
Follow me on Twitter/X: / highyieldyt
0:00 Intro
0:55 Current semiconductor manufacturing
3:27 The problem with the frontside silicon & metal layers
7:35 Backside Power Delivery manufacturing
11:06 Advantages of BSPD / Intel PowerVia / Blue Sky Creek
14:24 Design-Technology Co-Optimization / cell area scaling
15:54 The Future of Semiconductor manufacturing
Пікірлер: 403
Greetings from the Intel 20A BPD team! I was involved with Blue Sky Creek (BSC) in its early stages, but was moved from the team to work on 20A proper before they hit the labs post-silicon. I did my PhD on the development of modeling and optimization methods for chip to chip power delivery, focusing on multi-chip-module designs and finishing in 2020. Feel free to ask me anything about this new technology and I will happily share what I can.
@HighYield
Ай бұрын
My first question would be, how much did I get wrong? :D
@DigitalJedi
Ай бұрын
@@HighYield I could nitpick stuff for sure, but you didn't miss much. One thing that would have maybe been good to mention as I see a lot of comments asking about it or maybe misinterpreting it is the thermal consequences of the new design. With the transistor layer moved into the middle, it is true that you have to pull the heat from them through more silicon, but the reduced waste heat from other parts of the die such as the significantly lower resistance in the power vias more than makes up for it. I think we measured something like 20-30% lower resistance in some scenarios, which means a lot less voltage drop from contacts to transistors. That power loss from resistance is a significant portion of the heat generated by a modern chip. I can't say exactly how much, but ARL could actually use that to see a reduction in max power for the first time in a lot of Intel generations.
@GreenishlyGreen
Ай бұрын
Hey, I'm just a person. But you did say you would answer questions so... What does this mean for mobile phones?
@parsnip908
Ай бұрын
I've got a couple of questions for you. I'm currently studying computer architecture so i might just be missing some common knowledge about manufacturing processes 1) If the pin connections are now on the backside along with the PD network, how do external data signals connect to the signal network? 2) is more material lost/wasted due to adding a new carrier wafer and removing the old one? (8:50)
@DigitalJedi
Ай бұрын
@@parsnip908 Power and I/O are still routed to the same side eventually. This isn't reflected well in diagrams because you have to cut away somewhere. Most of what is on the frontside is the communication network on the chip, as this is what really dominates those low metal layers and gets in the way of other stuff. BPD should really be called BPD&I/O. You can still mount the chip in a BGA form factor like normal. There is technically more waste material as you use 2 wafers in the production process, but since the yield can be quite high and the pitches in the metal layers relaxed, you can actually save money in the production process. This is part of why 18A will be offered externally after the technology proves itself on 20A.
A High Yield upload? Time to fill my brain with all sorts of semiconductor knowledge goodness
It's crazy we've gotten to the point where we can make this stuff at all.
@BlueRice
29 күн бұрын
Yeah... yeah it's crazy. It's a feat of engineering in mass production. It's to the point where technology reaching its limitations so they have to precisely improve everything as possible to get performance.
@gnorts_mr_alien
14 күн бұрын
When I hold a chip when I'm building a computer or something, I get the chills. This is the closest thing to "alien technology" we have IMO. The fact that you can get such an artifact for some hundreds of dollars is insane. Not to mention the enormous use you get out of it.
Small clarification regarding the M0, M1, M2, etc labeling. Using the BEOL image from wikipedia at 5:45, you identify and highlight "M0" as the lowest metal layer in the BEOL steps. In your image, M0 would actually be the tungsten metal, which is identified as part of the FEOL processes. M0 is often called a "local interconnect", because it is a metal layer that is laid directly on the Si surface, and is used to connect immediately local transistors together. For example, in an Inverter gate with 1 NMOS and 1 PMOS, where the Drain of each transistor is connected to the same node, an Local Interconnect would be used to connect the Drains, by depositing a M0 layer directly on the Si, contacting the doped areas of the transistors that form the Drain. M0 is made of metals like Tungsten or Ti Nitrite, and not of the typical Copper or Aluminum metals used in higher layers. So M0 is a "special" metal layer used for local interconnects, because it uses different material and has to be deposited and formed in different ways than the other metals, because it's in direct contact with the Silicon. It's also used as the "Contact" metal for higher metal layers that need to reach the Silicon. M0 is the only one that actually makes contact with the Silicon, being deposited directly onto the Sources and Drains of the transistors to form vertical contact structures. Then, when the wafers move to BEOL, the first "typical" metal layer, M1, is made of Copper and it goes down touches the top of the M0 layer. In your BEOL image, you can see that the orange metal layers are labeled Cu1 (Metal 1), Cu2 (M2), up to Cu5 (M5). Each of these layers really comes in a pair of layers, because each Metal layer requires 1 layer for "Vias", which are the vertical structures that make contact between 2 metal layers, and 1 layer for the horizontal metal layers themselves. In the image, "Cu1" actually includes "Via1" (which is the vertical contact between the top of M0 and the bottom of "Copper 1") and "Copper 1" (which is the Metal 1 layer that makes the interconnects between blocks). Both Via1 and Copper1 each require their own photo masks and process steps. Then "Cu2" is actually "Via 2" (the vertical connection between the top of Copper1 and the bottom of Copper2) and "Copper 2", again each requiring their own masks and steps.
damn that was extremely insightful, info that I could never find on any other mainstream analysis channels
@theminer49erz
Ай бұрын
You are correct! I have been so happy I found his videos shortly after he started. I have always been impressed and he quickly became my favorite hardware information resource. I'm so happy to see him getting the appreciation he deserves! It's amazing how fast his audience has grown! As well as how he hasn't let it go to his head. You can tell he does it because he likes it. None of that arrogant "blah blah blah join this community (based around myself!!)" nonsense. No pumping out videos just to game the algorithm etc. Just good information, excellent insight, and straightforwardness!(not sure that's a word, but oh well). The only problem with him not kissing thw algorithms butt is that YT almost never notifies me about his videos even though I am subscribed and have all notifications on. Anyway, enough kissing his ___😊
I work on Global Foundries' 22FDX process node which is a 22nm FD-SOI process for RFIC layout design and I gotta admit, this would be ridiculously useful in ways I can't even describe for the RFIC or Analog industry. I imagine it'll get significantly more useful the smaller your process node since the resistances get real high real quick when your metal connections have to be incredibly thin and the vias are tiny. If I could put my thick power delivery wires on the back and not have to share the area over a bank of devices with the data wires my life would be a hundred times easier and I could work at twice the speed. This could even allow some sort of automation for the power routing. Everything would become significantly more power efficient and thermally ideal by doing this too. I must admit, I was rather surprised to find there was only one bottom layer metal (M0). In my process node we have M1 and M2, before going to higher layer block routing metals. I guess it makes more sense for a larger process node and for RFIC design
@DigitalJedi
25 күн бұрын
I can't say a whole lot right now, but I will say that there is active development for the type of power routing tools you're talking about. At the very least there is talk of offering assisted power routing for some 18A customers.
My head actually hurt from trying to comprehend the scale of complexity in designing this. Truly remarkable.
@ephelesfrance7006
13 күн бұрын
did i see correctly in the video THERE ARE 700 STEPS in making a chip nowadays. if so quite remarkable the complexity. i did work in a prototype circuit board manufacturer many years ago we had many steps but this on a whole another level and minituratization. acautlly id say about the end of the road for making chips like this so complex so expense the machines and to get defective ones down to a minumum. id say best thing to do is nanotechnology move around atoms by atoms so much more simpler than this way. building from the ground up atom by atom rather than this way too over the top complexity. soon it will hit a wall where the expense and complication and how much people will to pay for it what you made not profitable. already the costs for a new chip plant ie TSMC Arizona new $12 billion usd - $40 billion usd. Nanotechnology keep it simple stupid the way to go. its been on the drawing board for 30 years at one it will happen
You didn't comment on heat dissipation, as there will be more layers on the bottom of the trasitons it could become more difficult or even more heat, I hope more videos like this, thanks for the content!
@ItsAkile
Ай бұрын
Yeah theres been alot of discussion on this but still not clear, I think it might just put 300w consumer CPUs in the pass
@pedro.alcatra
Ай бұрын
@@ItsAkile Yes but It still being a go for notebooks and SI OEM. If have to bet I would say it is for E-Cores only chips
@HighYield
Ай бұрын
Intel said there isn't much of a difference and the increase in efficiency (less energy lost to resistance = less heat) makes more than up for any decrease in thermal capabilities.
@ItsAkile
Ай бұрын
@@pedro.alcatranah, that was just for testing. It’s a full feature to be widely implemented
@kahnzo
Ай бұрын
I just saw someone adding cooling to both sides of a motherboard which didn't make much sense to me at the time. And the POC didn't work very well. I would think that the power delivery side would need the most heat dissipation. This seems super promising.
Another fantastic video man👏🏻👏🏻You’re literally one of my top 3 favorite tech channels, great combination of in-depth knowledge and understandable delivery! Please never stop making these quality videos!👍🏻
@HighYield
Ай бұрын
Thank you! I remember watching a video from you about how to optimize speakers a few years ago :D
@Frytech
Ай бұрын
@@HighYield Haha small world, man!😀 Once again, highly appreciate what you’re doing here with these superb video!👏🏻
Wow! Seems amazing, thank you for diving deep into how technology works, there are not many resources dedicated to that
I never understood why power was on the same side of the wafer... It was basically one of the first things that came to mind way back as a student already. As a student I had to draw PCBs and was taught that the power lines should be as much separated from the rest as possible, for safety and EMI reasons... so I never got why they didn't apply the same rationale in designing these dice.
Amazing. I also think having the metal layers for data and power separate could allow for easier "glueing" of smaller dies together to form a bigger chip as you can route the I/O on top without going to the package substrate or even solder bumps. Glue the chips together, then etch the hermetic seal and build yet another bigger metal layer on top of the smaller glued dies to make the I/O path even shorter. Thus you can make a huge die but with smaller yields. That wasn't possible with flip chips, but now one could imagine that being possible.
thanks for the explanation. It was really clear and easy to grasp 👍
Don’t forget that lower thermal resistance is intrinsic to this as well
@HansSchulze
13 күн бұрын
As well as increases power capacitance very near to the transistors, allowing lower noise. Larger surfaces of power planes are free massive capacitors. Nvidia used available space in the metal layers to make capacitors to reduce power noise. Add to that, keeping (now lower) power noise away from the signals will help too.
@geekswithfeet9137
13 күн бұрын
@@HansSchulze and less parasitic capacitance to signal lines
I'm very happy to see this video. Slight bit of criticism - give yourself time to speak slower sometimes. I'm around 7:56 and it is hard to understand you, it almost feels like you're trying to speak as fast as possible. I don't think it applies to whole video, but it does to some segments, so in the end if the video was 20 seconds longer it wouldn't hurt that much. But your content is top notch - and indeed problem of power delivery and data transfer, wiring etc. is a problem that is constantly evolving. Meaning that even if you find a solution, often people will take it for granted and within couple of years you will have to find other solutions to very similar problems. And yes, half of the evolution of microchips might be smaller nodes, but the other half is how to get them powered and linked. Very underappreciated topic, so I'm glad you're covering it! Good Job! 👍
@aapje
Ай бұрын
I played the video at double speed and had no problem understanding High Yield. I think that he articulates very well for a non-native speaker. Just my 2 cents.
@jannegrey593
Ай бұрын
@@aapje Agreed. It was only around the time of timestamp - first few sentences in chapter "Backside Power Delivery manufacturing" that I had trouble with. Though I'm not native speaker myself - and I wouldn't be able to follow half of KZread at "2x speed".
such a good vid. i've learnt a lot :) thanks mr high yield
Hey good to see you again buddy!
must watch channels, especially tech discussions with precise details, epic 🎉
another well paced, well-explained semiconductor. Amazing!
Great Video! Always a joy to see one of your videos
Very clear explanations, great delivery.
As an engineer in Kulicke & Soffa 24 years ago this content somehow educates me on the updates of the semicon industry. Thank you.
One of the better illustration and explanation. Thank you
super technical video, presented in an excellent manor which was dense with actual information... too often, people make videos where they TALK a lot of words, but, dont really SAY anything ! great video
I wonder how this affects heat.
@TheTheSssupermario
Ай бұрын
power efficiency allowing for higher clocks with less voltage means less heat but also mean for more overclocking room for higher cooling solutions so overall more it scales to be the same as todays you get the best speed you can for the temperature you can maintain. what it really means is devices are gonna get even faster and efficient.
@TheTheSssupermario
Ай бұрын
one variable i would like to know is what part of the die generates more heat than the others but am assuming it would be the power delivery and i/o but if this design improves those power lanes I think that might improve the heat waste generation am not sure of those detail. but would be nice to know.
@abcbcd2159
Ай бұрын
I am not a qualified semiconductor expert, but assuming that the total die thickness stays the same, I would think that backside power delivery would improve temps, and not only because of the improved power efficiency. The transistors have been moved slightly closer to the IHS, and they have the copper signal wires between the transistors and the IHS conducting the heat towards the IHS. on top of that, the larger power wires may also improve temperatures due to their increased thermal mass.
Excellent video. I always learn so much from your videos.
Another banger. Thank you, Mr High Yield
good tutorial very well organized and presented for comprehension. mb
@mikebruzzone9570
Ай бұрын
On the old rules Meteor Lake cost at risk, ramp, peak, run down per unit cost will progressively move down from $227 per unit cost at risk production moving down through peak and just past peak to $88 marginal cost per unit at the 36th millionth unit of first gen disaggregate SIP production. The question is where is learning right now on realizing those marginal cost reduction objectives. mb
People working on these things are heroes. The significance of chip-making cannot be understated.
Thanks for the explanations, I really love this kind of videos
always so enjoyable to watch! even if i don't understand 90% of what's happening lol.
@HighYield
Ай бұрын
I understand at lest 70%!!
Great explanation. Thanks for doing this.
I don't think it'll be long before that second silicone layer starts playing host to a second layer of transistors.
@VincentDangerWater
8 күн бұрын
And then we can start playing with architectures that have top layer "master" cores, in setups with bottom layer sets of 2,4, 8, 16 small "slave" cores.
I do have to wonder about thermals and whether that will limit the benefits for P cores. The main heat generating component is the transistor layer and this method puts the signal layers in between that layer and the cooling system. People used to polish down their CPUs just to reduce this distance by several nanometres and improve performance so I don't think it would be insignificant
@sznikers
Ай бұрын
Everything you said makes complete sense from physical point of view, but they did claimed 6% frequency increase so lowered power losses combined with better signal quality must completely offset higher thermal resistance. After all all that wasted power in classic design was ending as heat and not optimal signal network meant they had to use more power to hit frequency target.
@theftking
Ай бұрын
@@sznikersyeah what this guy said.
@DigitalJedi
Ай бұрын
@@sznikers Pretty much exactly this. Cleaner signals means you don't spend as much power cranking your transmit and receive points, and you lose less to resistance everywhere since the paths can be direct and physically thicker.
@harshivpatel6238
Ай бұрын
Current intel method is to push the cores highest you can do, with BOD&IO , you have to find a good balance b/w how much power you can push vs what perf target you want. It an added constraint to manage.
@musaran2
28 күн бұрын
Lapping (not polishing) CPUs & heatsinks was to improve surface contact, not reduce thickness.
स्पष्ट अवलोकन , प्रज्ञावान विश्लेषण और बहुत सुंदर समीक्षा कुलमिलाकर अर्धचालक यंत्र के विद्युत और संकेत वितरण प्रणाली और तकनीक के विषय पर बहुत सुंदर प्रस्तुती। 👏👏👏👌👌👌
Thank you for such an interesting video. A question, do you know if power via will help to scale i/o so analog parts of Chips further down again, as new manufacturing nodes only scale compute further down and analog and sram are lacking there. Is power via helping here in better density again?❤
I would like to know does backside power delivery allows SRAM start to scale with the process node again? It would be interesting
@aniksamiurrahman6365
19 күн бұрын
Very interesting question.
Finally BSI content that is digestible and can be understood ^^' Thanks!!!
@HighYield
Ай бұрын
Glad it was helpful!
This was fantastic! Thanks!
Awesome Video, thanks!
The Chipmachine factory ASML have been/are redesigning some parts that I/we make as their supplier. one of the assys was pretty much flipped upside down. but the changes are only expected to hit production in a year or two. Fun to see this kind of tech developments reflect on things that I see happening at work. Because as a supplier of parts you never get the full picture of what they're actually doing.
Man, you rock!🤘Awesome content as always
Woohoo! Yay! Missed ya man! Thanks!
@HighYield
Ай бұрын
I had the script sitting around for weeks, but never got to filming :/
very informative, thank you
@HighYield
13 күн бұрын
Thanks a lot for the tip!
Super curious about the primary heat path in this configuration. It seems like it would have to be down into the power layers and ultimately into the substrate and PCB.
Great article, question on the backside IO routing, obviously the IO's need to connect in some shape or form to the Top Side signal routing, How is this performed, you would have to route from backside through the silicon and out to one of the top side metals? I can't visualize this and at what top side metal layer does the IO connect to? Is there one large via through from back to front?
Such good content!
Still don't know how they connect them to pcb front and back both
@HighYield
Ай бұрын
The frontside doesn’t need to be connected to the PCB, as it only handles chip internal communication. Power supply and I/O is routed through the backside, which is the side connected to the PCB.
@RobBCactive
Ай бұрын
To think when I did chip routing software, a 3 metal layer process was considered advanced. It's getting indistinguishable from magic now 😉
Very good explanation
Awesome, thx! 😍
I consider myself a chip enthusiast (I regularly use and program computing devices). This was very interesting.
I learned a lot about the old way of manufacturing also!
Great video thank you.
do you have a link to the article that the logic/power separation at 7:17 comes from?
@HighYield
Ай бұрын
Here you go: ig.ft.com/microchips/
Thank you for this video. I now understand a bit of what all the fuss is about, and I think the fuss is fully justified.
Since this method works both sides of a die, could it be used to further develop the transistor layer before making the second metal layer?
@techmage89
20 күн бұрын
Yes, I believe Intel is looking at making stacked "CFET" devices, which effectively form a vertical NMOS/PMOS pair that can be connected on both sides.
This is brilliant; going to change everything
7:19 WOW!!! 😱
Excellent work!
Great video :) I was wondering, why don't they create the signal layers first, then the transistors and then the power delivery? That way you would avoid grinding down to the transistors and adding structural support again.
@fluffy_tail4365
Ай бұрын
that would need an entire redesign on how the silicon litography part works I think, wich would lead to many new costs for validation and R&D necessary
@eggnogg8086
Ай бұрын
I think the transistors themselves need the silicon wafer, they can deposit a metal layer on top of silicon but not a silicon layer on top of metal, my best guess, not an expert
@HighYield
Ай бұрын
Because the metal layers have to connect to the silicon layer and building up silicon on top of metal seems like a really difficult process.
@JoeLion55
Ай бұрын
@@eggnogg8086 @jorenboulanger4347 - that's right. The silicon substrate (the wafer itself) is the magic that makes semiconductors work. Transistors have to be built directly into the silicon itself. Then, metal layers are deposited on top of the silicon. So the FEOL processes that @highyield talked about embed the transistors directly into the silicon (and with 3D transistors like FinFETs and nanosheets, there is some deposition above the Si as well, but the point remains, the transistors are build "in" the Silicon). Then, we need to use metal to connect the transistors together. This is the BEOL processes, which start building layers of material on top of the silicon surface, including metal and oxides and insulators, etc. So, essentially, the FEOL processes are taking a bare silicon wafer, which is a nearly perfectly pure, crystalline substrate, is required to build the transistors, then metal layers are added on top, which can be deposited using other processes. The whole process starts with a blank Si wafer, so the transistors have to be built on it. You can't, for example, built a bunch of metal layers first on top of the wafer, then build the transistors on top of those metals, then add more metal on top of the transistors, because the transistors have to be built directly in/on the Silicon wafer. So if you're starting with a Si wafer, you have to build the transistors first, then add metal layers on top. Then flip the whole thing over, grind the backside of the wafer down so the bottom of the embedded transistors are nearly exposed, then build up another set of metal layers, creating a metal/silicon/metal sandwich
Seems it would help with cooling too, if the transistor layer is closer to the heatsink contact surface
how is this gonna effect the cooling of the chip? Can the normal cpu coolers still be used?
Great video
Why no video about the qualcomm nuvia chip?
Great video. I'd love it if you a made a another one about Samsung's backside power delivery mechanism.
@DigitalJedi
Ай бұрын
Samsung's isn't far off from PowerVia, but it would be an interesting video to compare the 2 once both are on the market. Hopefully we could get a comparison of 2 actual dies and see what makes them tick.
@Ping12358
Ай бұрын
@@DigitalJedi IIRC it'll debut with SF2 next year.
Double sided circuits on the chip is even more efficient and vias to connect power and signals between both sides. Next is stacked chi been done?
I was always impressed that they were able to maintain 10nm for so long
You can never count intel out.
This channel is just 🤩
Could you explain how the metal layers interconnectors are built? The ones that go above and below the transistors?
@HighYield
Күн бұрын
That be a interesting topic for a future video.
Very interesting. Also crazy engineering.
Why is a BSPD not flipped at the end? It gets flipped to build the backside on top of the wafer and should then be flipped again to connect it to the substrate or what am I mistaking? (Timestamp: 11:05)
@HighYield
Ай бұрын
Duplex is in regards to the frontside (= the top of the wafer) facing downward. With BSPD the backside is down and the frontside is up. So it’s technically not in a flipped position when finished. It’s not about if you flip the chip during manufacturing. Maybe I could have explained it better.
@RealLifeTech187
29 күн бұрын
@@HighYield Thanks for the explainer 👍 so flip chip is basically just another phrase for backside up?
Thanks for clearing up how the chip is connected to the substrate. I looked for this answer very long, your explanation makes sense 💪💪
Appreciate the video, how does this approach translates to clock speeds? If the power network is longer does that mean lower clock speeds? Also if it has so many advantages and even cheaper to manufacture why this hasn't been done before? 17:30 in this frame you can clearly see Mitsui, I had no idea they made semiconductors as well. Are Japanese also at the cutting edge of semiconductor manufacturing?
@HighYield
Ай бұрын
The reduction in voltage drop leads to a cleaner and more stable supply of voltage to the cores, which results in higher clock speeds. Just like (on a different level) a better and more stable PSU can also help stabilize a overclock. It hasn't been done before, because up until recently you didn't really need it and frontside power was good enough. Only over the recent years the metal layers have become so complex, that it made looking for a solution a viable option. As for Mitsui, I think we are looking at a photomask or a cover for one. It's a mask for Intels Meteor Lake.
Im curious where you got the image you used for the thumbnail? Was this an AI generated image, or did you find it somewhere? Could you share a higher res version?
@HighYield
Ай бұрын
It's AI generated and then I edited it with Photoshop. I can upload a high-res version, but it's not a real prodcut or anything like that.
@Eikonic_
Ай бұрын
@@HighYield I really like the look of it as a stylistic reference. If your could share that would be great. It's just hard to make it the details at such a small size.
@HighYield
Ай бұрын
@@Eikonic_ Here you go: imgur.com/K23zDl0 (that's the original AI generated image)
@Eikonic_
Ай бұрын
@@HighYield very nice! which AI did you use? i gave a quick try with Adobe Firefly and it looked like crap. This is super clean and detailed. Thanks for sharing!
Intel needs to hold for at least 2 more years before their foundries get momentum.
To clearify, this will not affect how these get connected to boards. Correct? It will however mean growing a layer of silicon on the top ofnone of those metal layers. I wonder how that will work out. Im Only used ised to starting with one wafer then building atop .
Next step is stacking transistor layers?
I wonder what about heating and cooling when silicon is in middle layers?
New favourite channel
I just came here from the video you made about VFET and i was thinking what if Intel mix this new manufacturing process with the lowest node plus newest transistor design and you pop up with all that (with the ribbonFET) Thanks for all the high qualitty content Now i cross my fingers to Intel and AMD uses all this improvements not to make efficient chips but lower the current power draw. A desktop Ryzen 5 or i5 consuming even 30W at high loads would be a great advance
What about cooling? Having transistor side closer to heatsinks significantly improves heat transfer I would imagine. Considered they are pumping hundreds of Watts into their chips, it sounds like it would actually decrease performance as for e.g. "turbo boost" wouldn't be able to clock as high.
@DigitalJedi
Ай бұрын
The gains from the lower internal resistance pretty much completely offset this. Blue Sky Creek saw a 5-10% clock speed increase over production-volume Intel4 node chips. For an example, if Meteor Lake were using this test node, you would see boost clocks about 400mhz higher on the P-cores and 250mhz higher on the E-cores, which doesn't sound like much, but it is done at the same power draw.
@musaran2
28 күн бұрын
@@DigitalJedi “Back in my days” ™ 400 Mhz was the whole processor speed. If you were lucky, and rich.
Great summary and explanation. In addition to backside power delivery, I think we have already seen another thing that helped with segregation of data/memory and power. That was the use of chiplets or tiles. Instead of having a monolithic piece of Si as one CPU chip that has everything, now they have different chiplets purposely optimized for each function.
Saying "Design Flaw" is grossly incorrect, as everything in engineering is a compromise, not a flaw.
@HighYield
Ай бұрын
I mean it's a compromise and a flaw at the same time. But you have a point. Still, I need to create some interest in the content of the video ;)
@andre_ss6
27 күн бұрын
I think it was a joke 😅
Things might get cooler too :)
Given the significant benefits of backside power delivery outlined in the video, how might this technology influence the future landscape of consumer electronics, especially in terms of device miniaturization and energy consumption?
finally a good videoi about powervia!
Something I've said for the last 3 - 4 years, in paying attention to what transistor density is moving towards, I've been skeptical of these neverending videos about having to move on from silicon based ICs because we are near its limits. Well, while we might be approaching a point of diminishing returns for transistor density what I have said is the more important issue is going to be one of power consumption because really, approaching 500 million transistor in a sq. mm is a LOT. As in, you can have a powerful computer in your hands and that day is already coming as handheld game devices have shown. Humans will never need a handheld that can solve every secret of the universe. To be able to get the power of today's desktop computers which are pretty powerful into a handheld is about as good as it needs to get and we can solve that problem with silicon based circuits. The bigger issue is engineers needing to get better and better about parallel processes, not only in software but hardware so we don't need to clock a handheld device at 6GHz.
This is going to be **HUGE** for both power efficiency and thermal management
The graphics are top notch
@ephelesfrance7006
13 күн бұрын
i noticed that too. i dont beleive he created all that too a ton of work too do so for sure.
I assume that in MCM chips this advantage of backside power delivery becomes less useful?
@kazedcat
Ай бұрын
It is solving different problems. MCM is a work around on transistor density while backside power delivery is a work around on metal layer density.
@DigitalJedi
Ай бұрын
I actually did my PhD on pretty much exactly this. MCM and BPD solve completely different problems, and in fact you can use BPD to boost an MCM design. So it's quite the opposite really. The 2 technologies work very well together. MCM allows you to scale beyond the reticle limit without going to complex methods like pattern stitching, which is how Cerebras makes their wafer-scale chips. You see this pretty well with Nvidia's B100 and AMD's Mi300 series chips, which this channel has a fantastic video on. It can also be used to scale beyond a practical limit with yields or cost, which we see with AMD's Ryzen and Navi31 and 32 dies using older, more mature nodes for I/O functionality, or with Intel's Meteor Lake optimizing different dies for just one specific task. BPD works within the die itself to free up the internal signalling and external power and I/O networks from each other, giving more space to optimize both and lower internal resistance with thicker wiring for lack of a better term. This helps your MCM design as your chips have to communicate somehow, and that freed space on the power & I/O side means better links between dies. You can mount a bunch of BPD chips on an interposer to make an MCM design just like traditional dies. Intel has that in the pipeline already for some 18A-based server chips. You can even apply the same principals to that interposer if you want, using multiple layers for die-to-die vs external communication and package-level power.
I think I've seen "Backside Power Delivery". It's ringing a bell, for some reason.
Krasses Video Diggi
Since the first wafer is removed it could be thinner to begin with, saving wafer cost and time to grind it away. Also the final structural wafer wouldn't need to be suitable for transistor production, allowing cheaper materials (failed wafer recycling?) or even something with better thermal transfer.
@brodriguez11000
25 күн бұрын
Manufacturing that depends upon silicon support will have to change.
Maybe thin power lines should be left among the signal layers for even better power delivery. IMHO about PCs: A major power consumption is the connection between the CPU and RAM, by extension, should be the same for GPU and VRAM; this part could be replaced by optic-fiber/photonic connections, and use Copper-Fiber transceivers. This helps with power handling on the MB, heat and overcharge/overvoltage protections, but mostly faster delivery of signal; powerful optical routers use them and are faster than any Copper counterparts,; so it's a proven concept that should be applied ASAP
I wonder how cooling would change with this tech. If there are contacts on both sides of the CPU, how would cooling be supplied?
@DigitalJedi
25 күн бұрын
There are only external contacts on the backside. The frontside is now entirely dedicated to internal routing. It should be called BPD+IO. Your current chips are face-down, these will be face-up, so technically no longer flip-chip.
1:40 what if you do like a PCB and make double sided chips, or 3 layer silicon (or silicon substitute) with power delivery provided from said middle layer Now take amd Ryzen, instead of just using the top surface, you could put another full Ryzen on the backside, and use a sort of middle interposer for power delivery, and use some custom logic to simply run it like a multi core CPU, with hyper threading Now you realistically can get 64 core CPU or higher Same with a gpu
@Clancydaenlightened
Ай бұрын
In effect you split die thickness in half, with a center interposer that provide syncing and glue logic, and can still achieve backside power delivery for both physical units
@Clancydaenlightened
Ай бұрын
It'd be a weird looking package would not be compatible with current sockets due to cooling system changes, in this context you'd probably would want a heatsink dissipation capacity on its own of 300w and higher with liquid cooling The chip package probably would resemble a plcc style chip with the pin or contacts around the edges and towards the sides Because both sides are used, that would allow you to mount the chip on a riser card to facilitate cooling on both sides, but increase in space and overhead
@Clancydaenlightened
Ай бұрын
Call it Full silicon fabrication Already effectively 3d print certain chips like dram anyway to get storage density so making layered silicon PCB shouldn't be a wild idea Because that's all a chip is, a PCB On a PCB, connected to other PCB Each at a different scale You just shrink the PCB down so you only can see it under a sem or tem photography
Backside power delivery is a no-brainer, and was just expecting technology to catch up
It so easy in words, but... how to detach the nanometer-scale thin layer of ready made topology from the base crystal (remember - this is SINGLE crystal) and flip it over???
Subbed