AMD's CDNA 4 Architecture Announcement

https://chipsandcheese.com/p/amds-cdna-4-architecture-announcement

by rbanffy • 1 year ago

170 54 1 year ago

chipsandcheese.com

bee_rider• 1 year ago

Machine learning is, of course, a massive market and everybody’s focus.

But, does AMD just own the whole HPC stack at this point? (Or would they, if the software was there?).

At least the individual nodes. What’s their equivalent to Infiniband?

phonon• 1 year ago

Ultra Ethernet

https://www.tomshardware.com/networking/amd-deploys-its-firs...

https://semianalysis.com/2025/06/11/the-new-ai-networks-ultr...

OneDeuxTriSeiGo3• 1 year ago

It's also worth noting Ultra Ethernet isn't just an AMD thing. The steering committee for the UEC is made up of basically every hardware manufacturer in the space except Nvidia. And of course Nvidia is a general contributor as well (presumably so they don't get left behind).

https://ultraethernet.org/

jauntywundrkind2• 1 year ago

Also UltraEthernet went 1.0 (6d ago), had a decent sized comments: https://news.ycombinator.com/item?id=44249190

wmf2• 1 year ago

Cray Slighshot is even faster than Infiniband.

Now that Nvidia is removing FP64 I assume AMD will have 100% of the HPC market until Fujitsu Monaka comes out.

curt15• 1 year ago

Would traditional HPC applications using FP64 gain anything from CDNA4 compared to the MI300A?

latchkey14• 1 year ago

Within the node (gpu to gpu), it is infinity fabric.

Externally, it is 8x400G NICs, which is the limitation of PCIeV5 anyway.

We had a guy training SOTA models on 9 of our MI300x boxes just fine. Networking wasn't the slow bit.

robjeiter• 1 year ago

When looking at inference is AMD already on par with Nvidia?

moondistance3• 1 year ago

Yes, for many applications.

Meta, OpenAI, Crusoe, and xAI recently announced large purchases of MI300 chips for inference.

MI400, which will be available next year, also looks to be at least on par with Nvidia's roadmap.

moondistance3• 1 year ago

(this is also why AMD popped 10% at open yesterday - this is a new development and talks from their 2025 "Advancing AI" event were published late last week + over the weekend)

christkv• 1 year ago

Is the software stack still lacking?

latchkey14• 1 year ago

https://eliovp.com/cranking-out-faster-tokens-for-fewer-doll...

jauntywundrkind2• 1 year ago

Faster small matrix, for AI. Yup, that seems like good fit for what folks want.

Supercharging the Local Data Share (LDS) that's shared by threads is really cool to hear about. 64 -> 160KB size. Writes into LDS go from 32B max to 128B, increasing throughout. Transposes, to help get the data in the right shape for its next use.

Really really curious to see what the UDNA unified next gen architectures look like, if they really stick to merging Compute and Radeon CDNA and RDNA, as promised. If consumers end up getting multi-die compute solutions that would be neat & also intimidatingly hard (lots of energy spent keeping bits in sync across cores/coherency). After Navi 4X ended up having its flagship cancelled way back now, been wondering. I sort of expect that this won't scale as nicely as Epyc being a bunch of Ryzen dies. https://wccftech.com/amd-enthusiast-radeon-rx-8000-gpus-alle...

icf80• 1 year ago

no UDNA ? any news ?

incomingpain• 1 year ago

I bought a radeon 9060. ROCM works. I'm getting ~40 tokens/sec out of Phi4: 14B

BEWARE: I was running fully patched ubuntu 24 LTS and I needed to upgrade to ubuntu 24.10 and then ubuntu 25 before the drivers worked. Painful.

AMD's CDNA 4 Architecture Announcement

Related Stories