InTheArena

The 27b dense is _remarkably_ better at coding tasks.

Especially at larger quanitizations (Q4 is pretty crap).

I have a DGX and a Ryzen AI Max 395 - while I love both of them, there are a few critical things that leave the DGX in use, while the Ryzen "just" is my primary homelab server. The biggest thing is prefil numbers, and the performance impact of higher context sizes. Qwen 27b is a great model, nemotron is decent, gemma is workable. But all of them need reasonable context for reasonable outputs.

Unfortunitly, as others have noted, the DGX OS experience... sucks. My hope is that the RTX Spark (which looks to be the exact same stack, sans the high capacity network interface) will help this get a bit more attention, but nVidia's long long long war with the open source community is not helping. Focusing on mainlining kernel support would go a long way to getting the community to be supportive.

Of course, a massive regression just hit Linux 7+/7.1 plus for ROCm hosts, so it's just rough everywhere.

Then this isn’t for you. That’s fine.

The “the Jew was secretly a nazi” this post just spread is one of the most destructive bigoted and destructive anti-Semitic attacks in history

The last three times that Europe had a large independent military force(s), things didn't end so well for the world.

International commerce and business and shared democratic norms are a fscking good things. We have lost the people who learned that the hard way, and they are being replaced with people who have never read a history book.

s/China/Taiwan?

or Tibet?

You are comparing sensational trolls with actual geopolitical history.

The interesting thing is that there is a lot of evidence that Tesla is about to embed Carplay. Rivian has taken over the privileged insanely expensive EV car market, as the Model Y is the closest thing to the old Honda/Toyota dominance, just in the EV space.

This is completely infeasible in the age of mythos. The reality is that the velocity is just not going to feasible from a security PoV without leveraging these tools.

The jet lag team must be in Germany again. Sam, you being deuschbahnned?

Or if you want something from a vendor butting running decade old hardware configs and trying to lock people into their drive ecosystem, UNas or many other options.

Stay away from synology.

This is not a homelab replacement part. It’s enterprise with all the positive and negatives that come with that phrase. The second you start talking about old X hardware, it’s a different product class.

For that use case I recommend UNas from ugreen or the minis forum ryzen Ai stuff.

Synology hardware stopped being decent a while ago.

Most reports I ahve seen have 27b (which is dense) being much more performant then 35b (MoE). Is there a reason for 35b?

The market regulators don't give a fuck if companies screw over their customers privacy wise, as long as it's to the advantage of European companies and European customers.

This can lead to absolute insanity as companies try to satisfy both privacy and market conditions. It's not simple. How many years did google waste with Sandbox?

From personal, separate experience with Europe. It's quite common that the market watchdog and the privacy watchdogs are at odds with each other and make it impossible to achieve a solution that satisfies both of them.

Another example here is Google Chrome - which still allows third party cookies because even thought the privacy regulator wanted them gone, the market regulator required them to architect a solution that was unworkable to not take advantage of their gatekeeper advantages when others didn't have the same rights as them. Google finally said fuck it, and walked away from the privacy features in order to satisfy the anti-trust regulators.

Not shipping this feature in Europe is a common way to deal with satisfying the balkanized regulators there.

Ignore eletrek's self-serving post, go watch the youtube video.

https://www.youtube.com/watch?v=j5oyVNjrUPI

This isn't really true. AI laws in the EU mandate that Apple give full access to everythign on the device to third parties.

It's legit to be skeptical on the privacy front, but giving deepseek access to my entire phone. Or the TrumpAI at some point in a dystopian future seems... not great.

Big tech bro CEO Stokes nationalistic fears to justify corporate handouts for his company. Europe is more like America every day.

How many sales do that 1% drive? They also tend to be the evangelical users / YouTubers / tech bloggers that drive sales for the company.

Bambu is following Synology's footsteps here. And just like Synology, they will wake up to press at some point and common wisdom "don't buy Synology, the elite moved off when Green came out and now the rest are leaving too".

I own the most expensive Bambu (The H2C) - and even I am willing to admit that the snap maker is a great printer, and a better technical path in someways then the H2C vortek system for anyone who doesn't care about engineering filament

That's not true - that's a canary that Bambu through out there to distract from the thing that they absolutely took steps to force everyone into their ecosystem (which just happens to only sell their product, and to monetize prints directly for them).

As I recall, the features in the Selectric where what sank the Killian documents forgery a few years ago. Even the Selectric (which was the defense about claiming that the proportionally spaced document that was produced perfectly out of Microsoft word with default settings) couldn't do some of the existing things that word did by default, but it was still a technical marvel for its day.

How far IBM has fallen.

It's also worth remembering that Ted Turner also funded and asked for editorial changes to the the movie version of Gods and Generals, which downplayed slavyer and embraced the Confederate "lost cause" ideology. Most historians consider that as denial-ism on the same order as holocaust denial and the "stabbed in the back" claim that Hitler's used to seize power in the first place. He also attacked his own employees because of their religious beliefs. He later apologized for much of this, but if you want to find some of the reason for the modern return of fascism, you have to consider this.

I picked up the same monitor as the author. I'm pretty happy with it myself - I have the Pro-Art display that the author has as well, and the volume of color makes a huge difference for me.

But OLED is a remarkably personal technology. Some people also have issues with how the images are "strobed" during upgrades, etc.

This is incorrect. No sim support here, and no cellular modem either :-)

Yeah, I was thinking of running a Occulink connector to the side of the case, the problem is that this would need a riser, and I don't think that occulink - even with a redriver, would do well with two additional physical connectors.

On the 5GB realtek - i think their 5G is far better then their 1g or 2.5g devices where.

I ordered a framework desktop and got it "by accident" - in that I forgot that I had put down a deposit on a fully maxed out Ai MAX395+. After a few days of using it, I decided to keep it, and given how incredibly expensive 8tb NVMe drives and DDR5-8000 has beocme since then (even if you could get DDR-8000 on desktop form factor) - I don't regret that decision at all. It's a great little box - and AI is getting closer to colser to being a good experience.

That said, I have run into a set of frustrations with it: 1) The PCIEx is completely useless on the board. Forget about room for the slot - it's not exposed, there isn't enough exposure inside of the case. This is a real miss - It seems perfect for a occulink port or another USB4 port. 2) USB4 + PCIe tunneling was a mess. Seems to be working better now. 3) There are some real thermal envelopes that are resulting in similar systems with the exact same architecture running 10% faster then this box. That's a big bummer - apparently it's tunable in their bios, but framework really limits the bios settings. 4) Randomly right now, the latest kernel on Ubuntu seems to freeze on boot. No idea why - I can move to the older .5 kernel, and it;s working.

All that said, for what it offers - Framework offers a lot. I really honestly believe that either Mac or Framework is the way to go if you need significant compute power on the desktop.

Ubiquidropped all cloud requirements, but I am not sure what you are referring too here.

You’re probably better off getting a GL device. They already have support.

I really want to adopt the world view of this developer, but the more I read it, the more this comes across as someone relatively new to a particular industry who really doesn’t care about his job. I can empathize with part of this - who doesn’t want to live in the rat race, but this feels entitled more then questioning. That said, if his boss has a yacht, maybe there is a more money at this company then I assumed.

So where do you go, if you don’t care about growth? it feels like a government job (especially in Europe), a academic, or a factory line worker in Southeast Asia might be a better fit then software developer.

I pre-ordered and picked up a framework desktop with 128GB of DDR5-8000 inside of it. This is the type of system that is the a indirect byproduct of the change towards AI - it may not have been what AM was originally intending with the AI Max 395+ line - but it definitly is the kind of optimized thinking that will drive AI into the hands of consumers.

That's part of the reason I think this boom-bust cycle might be a bit different. Hopefully, Intel can use some of its capacity that they have coming up in the foundry to service this need.