HN user

Figs

1,329 karma
Posts14
Comments397
View on HN

it pulls around 400W

Try dropping the power cap on your GPU if it supports it; you can often get much lower energy usage with minimal loss of tok/s (particularly during generation) than whatever the GPU defaults to. There's a sweet spot around 200W on the GPU I'm currently testing that gives me about ~75% of the max pp and 97% of tg while using 100W less than the default/max 300W power cap -- and the card runs much quieter as a result.

AI for product development and management would be far more impactful than automating rote coding tasks [...]

Yeah, if this stuff actually worked that well already, OpenAI et al. would just run AI CEOs and engineers. Why get some other company to pay you at all when you can automate every other company out of existence and take all the money they make?

The fact of the matter is that while the tech has some uses, it sure as hell isn't a full scale replacement and you almost always actually have to massage the input into LLMs to get anything decent back out in practice. Some CEOs and managers can learn to do this, of course, and some already are... but that quickly turns into a second full time job. A "programmer" is still needed. The job might change from mostly hand-writing C++/JS/Python to prompt engineering + some manual coding to fix all the stupid fuck-ups that the bots can't solve themselves, but you still need someone to actually prompt the bot.

When that changes, it won't just be engineers losing work; there will be no reason to even have a human CEO any more.

27B is the dense one. Try the Qwen3.6-35B-A3B variants for the MoE release. That's what I'm running on a Framework Desktop and I get ~50 tok/s plus or minus a few. The dense one is similarly slow for me -- not sure what to expect on your hardware from the MoE but it should probably be much faster.

I appreciate the sentiment, but this law looks counter-productive if I'm reading it right. This is OBVIOUSLY going to push companies to make games into a subscription service to bypass the law even if they wouldn't have normally:

(b) This section does not apply to any of the following:

(1) Any subscription-based service that advertises or offers for sale access to any digital game solely for the duration of the subscription.

This exemption NEEDS to be removed. If a game's official servers are taken down, the community needs to be given the ability to keep running it themselves. Full stop. No exceptions.

I don't think GitHub has made a single UI change since ~2023 (when it went JS heavy) that I've liked. (Admittedly though, I've moved away from it for everything I have a choice about at this point, so it's possible they snuck in some good stuff when I wasn't looking.)

Also: having trouble getting this specific link to load -- just getting the unicorn error over and over.

The notation ExMm denotes a format with x exponent bits and y mantissa bits.

Shouldn't that be m mantissa bits (not y) -- i.e. typo here -- or am I misunderstanding something?

it's better anyways and surely close to a decade after coming out, we'd expect devices to support it well enough.

A lot of people, myself included, are still using quite old hardware. The GPU in my daily driver is ~10 years old at this point. Between crypto, COVID, and this AI craze raising GPU costs by insane amounts, it hasn't made sense to replace it with something newer. I know I'm not alone on that...

Iron and platinum have different melting points. If you melt the alloy, then spin it to concentrate the platinum, couldn't you coax the platinum to separate out as solid clumps by adjusting the temperature?

Alternatively, there are differences in magnetic properties that could be exploited...

This isn't my field, so I'm just spitballing. I bet if you can get the cost of launch and interplanetary transit to be low enough for people to really start tinkering with asteroid mining though, someone will crack the metallurgy issues...

Normal people can not install an OS.

Of course they can. They might be too lazy or ignorant to do so, but it's not really any harder to learn to install Linux than it is to learn to make mashed potatoes once you're motivated to bother -- and billions of people have managed to do the latter just fine.

Normal people are absolutely capable of following basic directions like: "download this file", "insert a USB stick", "run this program", "reboot your computer", "double click the install icon", "click the 'Continue' button (or similar) following the on-screen prompts".

The file in question -- good enough for most people with a Windows computer from the last decade: https://pub.linuxmint.io/stable/22.3/linuxmint-22.3-cinnamon...

The program to run: https://etcher.balena.io/#download-etcher

Detailed instructions here, including screenshots if you need them: https://linuxmint-installation-guide.readthedocs.io/en/lates...

$120K isn't going to cover the fully loaded costs of an SRE who can set up and run that.

Hiring 1 person to run the infrastructure means that 1 person is on-call 24/7 forever.

If there's an issue with the server while they're sick or on vacation, you just stop and wait.

Very much depends on what you're doing, of course, but "you just stop and wait" for sickness/vacation sometimes is actually good enough uptime -- especially if it keeps costs down. I've had that role before... That said, it's usually better to have two or three people who know the systems though (even if they're not full time dedicated to them) to reduce the bus factor.

The one place where OpenAI does have a clear lead today is in the user base: it has 8-900m users.

There is no way that number is an accurate reflection of the number of actual human users of their service. I could believe they have 8-900m bot/fraud accounts in their databases, maybe, but not real users.

I do not understand why Google doesn't just explicitly permit people who pay for premium to use yt-dlp or other tools to watch YouTube however the fuck they want. Put that in your terms, Google -- so people aren't afraid they'll lose their GMail because they wanted to watch a video -- and you'll get more paying customers...

Depending on the nature of your code, just throwing pypy at it instead of cpython can be a huge win. This very much depends on what you're doing though. For example, I have a graphics editor I wrote that is unbearably slow with cpython; with pypy and no other changes it's usable.

If what you're trying to do involves tasks that can be done in parallel, the multithreading (if I/O bound) or multiprocessing (if compute bound) libraries can be very useful.

If what you're doing isn't conducive to either, you probably need to rewrite at least the critical parts in something else.

The demo makes some nice spirals on the ends. They look like galaxies with the rendering.

It reminded me of one of my (cranky) musings from back in college about galaxy formation and whether they were more like tossed pizzas (i.e. spreading out) than like whirlpools getting sucked in.

If this continues for much longer, local/state governments can, should, and eventually will commandeer the taxes that currently go to the federal government. There is no point in paying federal tax if the federal government is no longer functional. States are already trying to step up with emergency declarations to enable financial support to work around SNAP being unfunded; passing state laws to redirect useless federal taxes to fund state food programs in order to prevent the alternative of immediate violent revolution as millions of people go hungry is an obvious course of action when they exhaust that capacity...