The PowerPC Has Still Got It (Llama on G4 Laptop)

https://www.hackster.io/news/the-powerpc-has-still-got-it-c4348bd7a88c

by stmw • 8 months ago

53 19 8 months ago

anon291• 8 months ago

There's nothing mysterious about AI. It's matrix and tensor ops which have been used for decades now. Hardware is pretty good at such things because memory accesses are nicely arranged.

nuc1e0n• 8 months ago

The memory accesses being nicely arranged is kinda why the focus has moved to AI in recent years. Moores law is that much easier to keep going if parallelization increases, such as with GPUs and SIMD on CPUs. That extra Silicon needs to be made productive somehow to be justified.

jchw2• 8 months ago

I am pretty sure Apple did not design or manufacture PowerPC chips at any point, so I'm not sure how that would be considered "custom" silicon.

And anyway, the source article seems a bit more interesting.

https://www.theresistornetwork.com/2025/03/thinking-differen...

buildbot3• 8 months ago

Interesting, that article says llama.c not llama.cpp. I actually got llama.cpp going on a G4 awhile back, I guess I should write that up.

Edit - I just can’t read, original article was llama.c

Gotta push my powerpc llama.cpp fork now for sure!

DogRunner• 8 months ago

Apple didn't design the PowerPC or make custom variances. Motorola and IBM did it. Especially Altivec was added by Motorola, and IBM didn't like to add it to their PowerPC CPUs when Apple asked for help, when Motorola had the 500 MHz glitch bug back in the day.

There is a nice coverage on this topic at https://www.youtube.com/watch?v=Tld91M_bcEI (Why the Original Apple Silicon Failed)

stmw3• 8 months ago

Apple was the "A" in the AIM alliance that created PowerPC, together with IBM and Motorola. https://wiki.preterhuman.net/The_Somerset_Design_Center

jchw2• 8 months ago

That I am aware of, but unless I just missed something I've never heard that they ever were designing chips.

buildbot3• 8 months ago

Oh someone else is as silly as I am? I hacked this together a few months ago as well! I guess I should have written it up.

I’ve been getting llama.cpp going on various weird, old systems as I can and qwen3.c where llama.cpp has no hope. So far, I’ve tried various sparc generations (IIi, IIIi, Fujitsu M10, and an Oracle M7), a C8900 PA-RISC, some riscv boards, an Alpha 21264, POWER 9, and many X86 and ARM systems of course.

actionfromafar• 8 months ago

Now, try https://www.winuae.net/

_rpf• 8 months ago

Im compelled to humblebrag my Sgi at this point … https://youtu.be/mzI8U7S0FDc?si=D70WbAak7_k7Ebrr

buildbot3• 8 months ago

Amazing!!! It’s really fun to see an SGI system + a modern LLM.

yjftsjthsd-h2• 8 months ago

Yes, you should definitely write that up and post it:)

pizlonator• 8 months ago

That's awesome!

I think that's the 12" G4 - still my favorite laptop ever, in terms of looks and form factor.

forgotoldacc• 8 months ago

That generation of Apple laptops was my tech awakening. I always thought of computers as tools just for office work and nothing I'd ever want to use. But one day I sat down in front of a G4 iBook and was like, man, this thing is beautiful. And it's pretty fun to use. I got an iMac a couple weeks after that and it set me on my programming career.

And just looking at that picture in the article, that keyboard is beautiful. Apple truly had some incredible design sense. It's very unfortunate how rough their design decisions have been the past few years.

stmw3• 8 months ago

Re: "very unfortunate how rough their design decisions have been the past few years" - one sometimes wonders if this is the inspiration:

https://vinpaq.com/compaq-collection

markgall• 8 months ago

I still have my old PowerBook G4 from 2005, with some not-that-old Debian currently installed. Every time my main laptop goes out commission, I get the G4 back out and use it for a few days. It's good enough for most of my work, though modern web-browsing is a challenge. (Maybe one that somebody has solved, I haven't dug at all.)

yjftsjthsd-h2• 8 months ago

though modern web-browsing is a challenge. (Maybe one that somebody has solved, I haven't dug at all.)

The usual solution is to run the real browser somewhere else and remote into it, eg. https://github.com/tenox7/wrp or https://www.brow.sh/

The PowerPC Has Still Got It (Llama on G4 Laptop)

Related Stories