Sophon PFG-1: a monolithic-3D AI ASIC with 330 GB of on-die DRAM and no HBM

https://www.phantafield.com/whitepaper

by minkowsky • 24 days ago

32 36 24 days ago

I've been wondering how long before RAM is fabbed on die to get around supply issues. This is one of the first I've read of so far. How long before Apple releases a CPU with ram on die?

minkowsky12• 24 days ago

Author here. The supply angle is exactly the motivation — HBM is the hardest part to get and ~26% of an AI rack's BOM.

First, separate three things people lump together. Apple already does memory on package (M-series unified memory = LPDDR5X dies next to the SoC). The near-term industry path is bonded stacking (AMD 3D V-cache, HBM4's logic base die). What we're doing is monolithic — growing the memory on top of finished logic. Three reasons that distinction matters:

1. Bonding only helps at the margin. A hybrid-bond interface still carries a relatively large interconnect capacitance in um scale, so at memory bandwidth the I/O drivers crossing it dissipate most of the power and overheat — you move the memory closer without escaping the I/O energy. Monolithic inter-tier vias are nano-scale (we model ~1% the interconnect energy of a bonded interface), and that's the only thing that actually moves the needle.

2. 2D-TMDs are the only functional CMOS you can build in the BEOL. Monolithic 3D means fabricating the upper tiers after the logic, at ≤450 °C, or you cook everything underneath. Silicon needs ~1000 °C; low-temp oxide semiconductors (IGZO) are n-type only, so no real CMOS. 2D-TMDs give both n- and p-type at BEOL temperature. Nothing else does.

3. ~6 orders of magnitude lower off-current (~1 fA/µm) finally makes a capacitor-free cell work. Conventional 1T1C DRAM needs a big storage capacitor — the deep-trench / high-aspect-ratio etch you can't do in the BEOL anyway. A 2T0C gain cell holds charge on a transistor gate with no capacitor; in silicon it leaked away in microseconds, so it was never usable. With 2D-TMD leakage you get ~1.8 s retention — refresh at ~1 Hz and drop the capacitor, and the trench, entirely.

robocat2• 24 days ago

TMDs

= Transition Metal Dichalcogenides

BEOL

= Back End Of Line. The later stages of semiconductor manufacturing (after the standard CMOS logic transistors) e.g. adding the metal wiring and interconnect layers. Think end of a manufacturing line.

The core concept is to layer multiple non-standard non-silicon memory transistors above the metal layers.

That sounds like a stunning invention, since I think that alone implies better memory density than current SRAM (ignoring the extra complexity of stacking it above a logic layer).

Rohansi• 24 days ago

They're typically manufactured with very different processes so one has to wonder what compromises are being made here to get both on the same die.

wmf2• 24 days ago

This design is absolutely wild. It probably won't work but I admire the dream.

minkowsky12• 24 days ago

Author here. The economy is more realistic than the wafer-scale ASIC by Cerebras.

binyu4• 24 days ago

Hello, kudos for the tremendous work. Could you explain the difference between your design and Cerebras?

Bests

JumpCrisscross• 24 days ago

Can you explain why?

wmf2• 24 days ago

I'm questioning technical risks such as BEOL transistors and 2T DRAM cell structure, not the economics. Cerebras has already retired their technical risk.

addaon• 24 days ago

Since when are we doing 32-layer planar transistor logic on a single chip? Even ignore the use of FETs for eDRAM… I didn’t realize we had decent logic density possible on BEOL.

minkowsky12• 24 days ago

Because we can put FET on any layer. Usually, BEOL doesn't need such high density. The density depends on what lithography tool and mask you pick.

brcmthrowaway• 24 days ago

What is this? AI generated company?

vessenes2• 24 days ago

Minkowsky, cool design! Question - the ASIC designers I've worked with over the years have been fairly adamant that integrating memory on package interspersed with logic is very difficult; the general statements run like "those designs always look great on paper, but never tape out properly".

Have you done any hardware tests of this plan? Is this still considered quality advice?

Second q, why start with 28nm? Is the idea that you want to stick with TSMC and be able to shrink? If this does in fact work well, I can imagine wanting to shoot for a smaller process node pretty quickly. Is there some sort of tech / design gap you'll need to figure out as you go?

gfody• 24 days ago

isn't cerebras the pudding proof of this design? it seems like ai chips galore are appearing from the woodwork but cerebras is 10 years down this rabbit hole and poised to dominate

vessenes2• 24 days ago

I believe cerebras is one wafer, not deeply stacked, each core is like half memory half compute by area.

minkowsky12• 24 days ago

Due to the thermal budget, most of the silicon design is constrained to a 2D layout. So the Memory is competing with logic for layout. Now we stack logic in the backend between metals.

We fabricated 2T0C DRAM arrays with a 3D monolithic structure. That's a must-do.

Why 28nm? Because it's cheap, widely available, and already gives us enough performance to beat Nvidia Vera Rubin. We have a road map, scaling it down. https://www.phantafield.com/whitepaper#6-scaling-roadmap

robocat2• 24 days ago

2T0C

2 transistor zero capacitors

See last paragraph (3.) of another comment for context: https://news.ycombinator.com/item?id=48713803

RobLach• 24 days ago

MoS2 lattice construction?

throwaway892012• 24 days ago

The entire design looks very interesting, but from the outside and without domain expertise I find it very hard to assess if anything about this is actually real or just a large and well-executed product of an AI psychosis.

The signs that this project is real are hard to verify:

- Angel investment by FinFET inventor Chenming Hu [1] seems a big vote of confidence, but there is no independent confirmation of this anywhere, except for two photo's in LinkedIn posts [2], which do look convincing.

- The NanoGalaxy PPMOCVD was presented at IEDM 2025 [3][4], but nobody seems to have written about it except the company itself. In this case, presenting means a poster presentation with a very vibrantly colored marketing picture.

- The NanoGalaxy PPMOCVD is built and in production, because you can "Witness a full 12-inch MoS₂ growth cycle on your own wafer lot" [5], but nobody has reported on this. A photo/video of the actual device would help a lot, but instead a very clean picture of what seems like a 3d-model is shown.

There are a few worrying signs:

- The submitter on HN presents itself as the founder. They have previously submitted other projects under the Phanta or PhantaField names [6]. Notably two hype cycle subjects: DAOs, NFTs and augmented reality, combined in a book that itself is rather 'out there' [7].

- The comments on HN by the founder are clearly AI generated with phrases like "honest caveat". The content seems to make sense (to a non-expert like me), but it's quite jarring.

- All the work except the NanoGalaxy seems to be theoretical for now, but written in very definitive language in extreme detail. For example "The die is built" with specific properties but then referencing three very experimental papers. This can of course be genuine (technical) marketing, but it's also very similar to AI psychosis work that I've encountered elsewhere. Although I must say in comparison this does look a lot more internally consistent and logical to me.

- I find it very hard to believe that the NanoGalaxy is actually existing and working hardware ready to "Witness a full 12-inch MoS₂ growth cycle on your own wafer lot". I would imagine you need a sizable team to produce such a new device, and that seems to be inconsistent with the way the company presents itself (a one man show of the founder). The absence of any verification or showcases of the device, or any evidence of a larger team make it suspect.

[1] https://www.phantafield.com/news/first-angel-investment-chen...

[2] https://www.linkedin.com/feed/update/urn:li:activity:7126002... and https://www.linkedin.com/posts/xuejunxie_its-a-great-honor-t...

[3] https://www.linkedin.com/feed/update/urn:li:share:7404253323...

[4] https://www.phantafield.com/news/12-inch-ppmocvd-iedm-2025

[5] https://www.phantafield.com/product/ppmocvd

[6] https://news.ycombinator.com/submitted?id=minkowsky

[7] https://xcancel.com/thepantheonai

minkowsky12• 24 days ago

I also have another side project, thepantheon.ai. I think it's ok to have multiple talents. To make the world a much more interesting place.

We talk to fabs. I am not allowed to expose any conversation. We don't need to prove to average Joe what we have.

It's indeed teamwork to bring it into production, even with huge help from AI. It also takes expertise to make sure AI is correct. As a founder, it's more of a merit than a drawback to create with a minimum headcount.

throwaway892012• 24 days ago

I think it's ok to have multiple talents.

Of course that's okay, but do recognize that most blockchain projects in general and DAOs and NFTs specifically have been considered frauds or at the very least pipe dreams by many on this site from the beginning. And wider in tech society from the moment the hype was gone.

We don't need to prove to average Joe what we have.

Of course you don't need to prove anyone anything, but it really can't hurt and there doesn't seem to be much effort in addressing the main issues. Not having anyone write about you also just seems like bad marketing: as you clearly are not in stealth mode, an extremely verbose public website stands oddly against no external coverage.

It's indeed teamwork to bring it into production

So is or isn't the NanoGalaxy an actually physical, working device ready for a demo? (which isn't necessarily production, but somewhat close)

elisbce• 24 days ago

What a great bullshit detector signal it is if someone's involved in the DAOs and NFT stuff. Don't waste your time on a fake AI-generated one-man shell company. The company had like 3 investments since 2017, first $2.5k from school startup grant in 2017, and two more from incubator programs in 2023 and 2024, for "augmented reality". And now you are the most innovative chip designer in AI. Nowhere on Chenming Hu's Linkedin said anything about being an official advisor for this one-man company. I can take a photo with Messi, does that make me a top soccer player?

minkowsky12• 21 days ago

There is a thread on why HN is so biased against crypto. I don't feel the necessity to argue here. Prejudice is what prejudice is.

https://news.ycombinator.com/item?id=31302494

Also, PitchBook is hallucinating about every company. Don't trust their data.

freakynit• 24 days ago

80B + INT4 + speculative (FP8 mode) => 72,188 tokens/s effective

..da fck!!

M95D• 24 days ago

Too advanced for me, but I still get the impression this won't help home users one bit. It's probably going to be FAANG-level expensive and FAANG will most likely use it against us.

mikewarot• 23 days ago

There are quite a few clever optimizations interplaying here. The use of bit-serial arithmetic, for instance, makes it possible to handle both FP16 and FP8 values without much overhead.

I wonder if the 2T0C DRAM could be used to directly feed a LUT, for FPGA applications. If so, that could greatly reduce their die size.

Sophon PFG-1: a monolithic-3D AI ASIC with 330 GB of on-die DRAM and no HBM

Related Stories