The Rising Price of Power in Chips

https://semiengineering.com/the-rising-price-of-power-in-chips/

by rbanffy • 2 years ago

115 33 2 years ago

datameta2• 2 years ago

In Figure 2 depicting 2.5D warping, why is 246C a relevant temperature? In my experience with IBM Power and Z systems, north of 85C is considered the high end already. What am I missing?

Interesting article overall.

mikewarot• 2 years ago

The picture shows temperatures up to 316K, which is 42 C.... so likely it's a typo for 46 (or 45?) centigrade.

It's the repeating of an earlier mistake.[1] Which apparently partially arises from [2] which is behind a paywall.

[1] https://www.prnewswire.com/news-releases/ansys-receives-2021...

[2] https://www.semanticscholar.org/paper/Heterogeneous-Integrat...

datameta2• 2 years ago

Ah yes, that's it right there. Excellent sleuthing, thanks.

godzillabrennus• 2 years ago

Great breakdown of current challenges.

amomchilov• 2 years ago

(ヮ)

RetroTechie• 2 years ago

What hardware advances giveth, today's beyond-ridiculous-overweight software stacks taketh away.

sliken• 2 years ago

I think of that as a win. Heavy software stacks create a demand for faster hardware and the market provides. Those of us with use cases that represent a tiny marketshare, but actually need the performance can do so with light software stacks.

So the question is, how can we make the overweight software stacks even slower?

Out_of_Characte• 2 years ago

By going back to using interpreted languages. No more precompiled binaries where changing/adding patches and flags require full builds, just stream compiled/compressed source code directly to the target.

You could also extern the software to a webserver and only cache small parts of the software on the client. Instead of gigabytes of install sizes you'll be required to have a 1 or 10 gbit network link to run and stream features as you're acessing them.

taneq• 2 years ago

Make it “industry standard best practice” to provide devs with absolute top end cutting edge hardware “for productivity and efficiency gains”. Repeat this at every opportunity at conferences and industry events until it becomes ubiquitous. Profit as devs slather abstraction layers, trivial libraries, emulation layers etc. on because “developer time is worth more than CPU time” and “it’s not slow on MY computer”. :D

VelesDude• 2 years ago

Pffft!!! No it doesn't. By the way, here is my new 'Hello World' app, it is only 380MB + dependencies.

dtgriscom• 2 years ago

There's a strong rationale for making software developers work on older, limited machines, rather than the latest and greatest flamethrowers. (Of course, that doesn't apply to me.)

bevekspldnw2• 2 years ago

I’ll replace my i9 workstations with an ARM equivalent as soon as I can. The power draw on i9 sucks, more so with the A6000 running.

error_logic3• 2 years ago

The idea that ARM solves power issues seems a bit overblown and driven by Apple purchasing the most advanced nodes sooner than competitors, causing people to associate the efficiency gain with the architecture even though a lot of it is the silicon process.

Edit: Also Apple can and does do away with legacy support which is less about the architecture and more about expectations of what is included vs. deprecated. The push to ARM seems like it will result in a loss of support and control in the users' hands (converting expectations of PCs into those of smartphones) but now I'm really into speculative territory...

lend000• 2 years ago

This is probably largely accurate -- not to mention the fact that Apple has been using efficiency cores longer than x86 competitors.

DinaCoder98• 2 years ago

Is there any evidence that x86 can compete with arm on per-watt computation?

robocat• 2 years ago

most advanced nodes

That's overly simplistic. It is the whole ecology of optimising for low-power usage on mobile that makes ARM so efficient. An advanced node does make a difference of course, but it is all the other choices made for efficiency that stack up e.g. big.LITTLE and the OS support for it. You can still get power efficient ARM on older nodes.

qball• 2 years ago

causing people to associate the efficiency gain with the architecture even though a lot of it is the silicon process.

They also cause people to associate higher performance with the architecture, when high-performance ARM is something more or less unique to Apple.

Qualcomm (as in, best case for performance that you can actually order a tray of 1000 CPUs from) is several years behind what Apple/Intel/AMD currently offers and as such is simply not competitive with x86 (even in performance/watt); that is one of three reasons why there are very few ARM laptops (the second one is that Qualcomm refuses to do drivers properly, and the third is that their price/performance ratio is positively abysmal). Sure, they're getting better with the acquisition of ex-Apple engineers through Nuvia, but there's still quite a ways to go before they're actually competitive.

ARM isn't a magic "make my computer faster" button; chip designers are doing the heavy lifting for any architecture.

bevekspldnw2• 2 years ago

Well, what I want specifically is an M-series Mac Studio equivalent CPU perf/watt I can pair with a dedicated GPU, running linux without jumping through hoops.

ezst• 2 years ago

If I was to pick a new CPU right now (and I won't, because I don't feel limited by my 2017 CPU still..., anyhow), I would just pick _not Intel_. AMD is also doing a great job on the perf per Watt department without throwing away decades of compatibility. Intel slowly catching up is something to be looking forward to as well.

moffkalast• 2 years ago

“The base leakage is lower than the previous technology, but the overall total power is higher,” said Melika Roshandell, product management director at Cadence. “So at the end of the day, your thermal is going to be worse because you’re packing a lot more transistors into one IC and you’re pushing the performance.

So why not match the previous gen's TDP and just use whatever gains you get from more efficiency?

Back in the 90s 300W was considered extreme for an entire system, today just a single 4090 can pull a full kilowatt. This constant increase manufacturers have been pushing to compensate for diminishing returns is unsustainable and completely absurd.

Vecr• 2 years ago

AMD lets you do that, and it's probably recommended in some cases. They don't force you to (except in some laptops?) because would give the user less freedom and because it would leave performance on the table. It does mean that the default boost settings have the chip running at a bit less than 100 Celsius on any standard air cooler.

milesvp• 2 years ago

I’m curious about what is happening in the field of reversable computing. I haven’t heard much about it at all in the last 20 years. Basic information theory tells us that it takes energy to destroy information, so building ALUs that limit destroying information seems like a bit of a no brainer for attempting to create lower power (and heat) computing. The basic premise is that for any operation that loses info you store enough bits to allow the operation to run backwards. If you were clever about it, you could design your chips to only destroy bits in places that can be effectively as well. I’m sure reality gets in the way of pure theory, but I was sure that people were spending enough effort on the concept to have heard more about it.

zozbot234• 2 years ago

Reversible computing doesn't help wrt. static or leakage power, which is an increasing fraction of power draw in recent device nodes. It does help wrt. dynamic power, and can be implemented via charge-recovery logic - but this comes at a cost in area which increases static power.

pillusmany• 2 years ago

Our power problems today are far away from the theoretical limits you described.

But reversible computing is inevitable in quantum computers, so it's researched in that context.

sgdpk• 2 years ago

I have worked on this aspect on quantum computation [1]. The main problem is that reversibility is a feature of isolated quantum systems. In practice, they are not isolated.

Why? It's not just because of small interactions with the environment that we cannot control. It's that even the apparatuses that we use to control/drive the logical instructions (lasers, electrical transmission lines) should be taken into account if the computer is to be considered isolated. But usually they aren't, and this leads to inevitable losses of reversiblity in the data register.

In other words, unitary (reversible) operations do not come for free.

I think that in quantum computers it is more likely that energy-efficiency will come from some sort of algorithmic advantage.

[1] https://arxiv.org/abs/2210.10470

ForOldHack• 2 years ago

Increase the surface area exposed to coolant. yea, Its an easy fix, but someone had to point it out. Pesky thermodynamics

The Rising Price of Power in Chips

Related Stories