pixelpoet

Zen3 isn't the best performing CPU today, though of course it'll never approach GPU level (which is pretty much ASIC level for matrix muls with special units). CPUs are getting dedicated "AI accelerators" too so it'd be interesting to compare per watt. The real limit is almost certainly memory bandwidth, not flops.

It would also be very interesting to see someone like Fabien Giesen / ryg do a maxed out AVX512 version for Zen5. His code's so fast it makes Intel 13900k's self destruct.

The next logical thought would be, maybe I want the thing I can't have (i.e. 100% of subscription used for Fable).

If they want to sell me 50% something I don't want then they get 0% sale and my money goes to their competitors. Simple as that, Anthropic.

Yes, yes, yes! I'm absolutely ready and waiting with dual Strix Halo machines here and really want something approaching Opus at home. Speed is secondary concern for now, that would absolutely change the world.

Qwen 3.6 27b 8b quant 16b kv cache is already pretty good on the Strix.

Most of us would struggle to imagine a world in which U.S. soldiers, police officers, Border Patrol agents and elected leaders could be dragged before an international court, tried by judges from random countries across the globe, found guilty under international laws we neither consent to nor control, and then imprisoned thousands of miles from America.

Strange how they don't have any problems with abducting people from other nations (plenty of recent examples) to stand trial in the US under US laws, complete with meme'ing about being sent to alligator Alcatraz etc.

I disagree, it's both right in the title and the topic of the article. Weariness (fatigue), not wariness.

Yes, I'm aware of the word wary; now look up "weary". Wary as in "beware" is different from weary as in tired. I see this mistake all the time...

Since we're talking about fatigue: weary*

Feels good to read this :)

People who make such blanket statements only see things in black and white.

We're about to find out! Not to mention all the doctors who'll be getting sick from hordes of people with basic cold and flu piling up in their practices.

Man, Merz truly is a genius! You can tell he's had so much experience in normal jobs, truly understands the average worker's situation.

"Wireless-free" is such a ridiculous designation; you have a double negation and it still doesn't mean what you might expect (that it's wired).

My man :) Alex Evans has been my gfx coding hero since the 90s with his demoscene work, and I had the privilege of working briefly with him at Lionhead.

I have a Framework Desktop as primary PC (great cooling, beautiful case with handle) and the Bosgame M5 dedicated for AI use.

I was also a bit wary about Bosgame but TBH they've been great and the machine is rock solid, if a little noisier than and not as pretty as the FD. You can just buy from them directly and be fine, best computer deal out there by a mile.

The Strix Halo mini PCs use the exact same chip, and have a much smaller footprint than any laptop. Have you seen the size of these machines? I can and have easily popped my daily driver computer into my very small backpack to attend a demoparty for example.

With the laptop you probably won't get silent operation at the peak 100-140w, i.e. you've now massively overpaid for lower performance.

I think people buying laptops for AI use are, sorry, just plain crazy. You overpay for the screen and keyboard and battery and whatever, plus you get much worse thermal performance because of basic physics (area vs volume). My Framework Desktop has a Noctua cooler which works really well.

[Tangent: all my life I've been downvoted into a smoking hole in the ground, particularly on reddit r/hardware, for questioning the wisdom of laptops for high performance computing, including gaming. Everyone insists they need the mobility, and then just leave it plugged in the whole time, absolutely refusing to admit it's about aesthetic preference.]

IIRC llama.cpp doesn't implement DSv4's compressed attention mechanism, and while it does use (credited) parts of llama.cpp, it's focused on this great model for now. Much of this is covered better in the repo's readme.

I have two 128gb Strix Halos and have been extremely excited about Antirez's (Redis author) work on DS4, especially with 4bit quant using two machines: https://github.com/antirez/ds4

Right now the speed isn't good for GLM 5.2, Deepseek V4 Flash speed is okay for me (actually reading the output) and quite usable. See kyuz0's great recent video here: https://www.youtube.com/watch?v=PkKXm_mKCCM

With a bit more speed and model improvements, local AI becomes a reasonable practical thing! The biggest problem is all the tech companies making consumer hardware completely unaffordable, and I don't think this is accidental. Look at Micron's profits and share price lately...

I got my Strix machines for ~2k eur each, best computers this 90s kid has ever owned, but those days are gone :(

Like Cursor, which is pretty much repackaged Kimi K2.5, and Musk paid $60b for (lol).

Then all they do is drive the usage of open models underground (copyright infringement is illegal too, and still common), stifle US companies operating legally, and accelerate the rest of the world decoupling from the US.

I hope they do it! It will have a positive long-term effect just like the Iran war footgun accelerates renewable energy transition.

Are these models still relevant for people outside the US? I get the impression we're stuck on GPT 5.5 and Opus 4.8 pretty much permanently now, and relying on Chinese models in future.

Sulfur hexafluoride escaping is exceptionally damaging as a greenhouse gas, is there nothing else they can use?

Edit: wow, serves me right for asking / not understanding that contrast means SF6...

"It is a well-known fact that reality has liberal bias." - Stephen Colbert

I was hoping for something more like,

"To overcome these self-inflicted challenges, DolphinDB stopped hiring noob developers trying to make HFT systems in Python, instead preferring run-of-the-mill C/C++ developers who understand heap vs stack allocation".

Edit: oh wow, check the poster's previous submissions :)

The most obvious objection to hyperbolic discounting is that many or most people learn to choose consistently over time in most situations.

So hyperbolic discounting isn't all it's cracked up to be huh?

Thanks for your insight, though I was referring to the sidelining of their GPU consumer business and transformation into what it is now.

I miss when Nvidia made GPUs for games and my OpenCL renderers. What is this trash...

The advantages are more on the development side of those apps, i.e. you can hire JS UI devs way more easily

Ah yes, we don't want Microsoft to run out of JavaScript developers to keep improving their desktop operating system in this manner. More webdevs, that's what's going to fix what ails Windows!

Love to see this, and love our privacy and data handling laws!

While we're doing anecdotes: I essentially never meet people who own an iPhone, and I've lived (3 months+) in a huge number of countries and cities. The handful people who do are American; bubbles exist :)

For a long time, high end graphics and games was mainly done on Windows and Visual Studio. I'm from that world, and only made the Linux transition last year November after Microsoft forced everyone's hand.