HN user

berniedurfee

662 karma

Lifelong professional programmer and amateur musician.

Music https://fieldsandwaves.band

Writing https://berniedurfee.substack.com/

Older Writing https://medium.com/@berniedurfee

Posts2
Comments521
View on HN

I think this is related to the concept of “aligned incentives” in a way.

The chain breaks when incentives aren’t aligned and there’s a cascade of crap that roles downhill that seem like bad decisions. When, in fact, as the article points out, the decision made didn’t take knock on effects into consideration.

I’ve learned that seemingly poor or even terrible decisions almost always make sense in the context of when and where the decision was made.

It’s the other way round many times. Companies get fat tax breaks to move into a particular town or city.

Those tax breaks are explicitly contingent on butts being physically in seats to add to the economy and tax revenue of that municipality.

Too few butts in seats triggers penalties or revoking of the tax breaks altogether.

This is the money grab part of the show.

As LLM capabilities start to plateau, everyone with any sort of name recognition is scrambling to ride the hype to a big pay day before reality catches up with marketing.

Here now, you just need a few more ice cold glasses of the kool-aide. Drink up!

LLMs are not on the path to AGI. They’re a really cool parlor trick and will be powerful tools for lots of tasks, but won’t be sci-fi cool.

Copilot is useful and has definitely sped up coding, but like you said, only in a boilerplate sort of way and I need to cleanup almost everything it writes.

You should _always_ be skeptical of what’s said by anyone who is trying to sell something.

Like everything else being sold, the marketing is 95% BS.

LLMs are amazing and wonderful tools, but me thinks we’re near a plateau in capability. Now investors are pumping for ROI before that becomes evident.

After we reach the plateau in capabilities, the next phase is cutting production and operating costs to maximize margins.

I’m the meantime, expect the marketing to get increasingly cringe until the bubble bursts.

No doubt it’s bipartisan!

Politician’s careers live and die in the fickle Court of Public Opinion. They’re probably the most susceptible cohort to AI fakes.

One of the rare times, it seems, that politician’s incentives are aligned with the populous. (Yes, I could have left that last part out.)

What country is immune to this?

As far as I can tell the collective conscious of every country is swayed by propaganda.

A written headline is enough to incite rage in any country much less a voice or video indistinguishable from the real thing.

Folks in “developed’ countries have their lives destroyed or ended all the time based on rumors of something said or done.

Regulation should allow students to forgo their tuition payments if they can’t land a good job in their field of study.

That’d help align incentives.

Schools would compete on placement rates and quality. They’d need robust post-graduation placement services and would need strong partnerships with industry players to stay in alignment with required skills.

I’m starting to think this is an unsolvable problem with LLMs. The very act of “reasoning” requires one to know that they don’t know something.

LLMs are giant word Plinko machines. A million monkeys on a million typewriters.

LLMs are not interns. LLMs are assumption machines.

None of the million monkeys or the collective million monkeys are “reasoning” or are capable of knowing.

LLMs are a neat parlor trick and are super powerful, but are not on the path to AGI.

LLMs will change the world, but only in the way that the printing press changed the world. They’re not interns, they’re just tools.

This is brilliant!

I always leave stuff for future remodelers or archeologists when I do remodeling or building.

Mostly coins, I throw a few in the concrete mix or inside walls for future generations to discover.

It’s always a treat to find long forgotten artifacts when remodeling old houses.

A little treat for people working on something I built 40 or 400 years in the future.

We’re in the middle of “The Dark Ages II” and we don’t even know it.

I’ve been thinking for a while about how historians will view our chunk of history and it ain’t too good.

There will be some bright spots, but for the most part humans have been behaving pretty terribly, at scale, since harnessing the power of electricity.

I used to play with this probably around when it first came out.

I’d sit in my dad’s office at IBM and use his all powerful PC-AT steel full tower PC.

It was so cool to even render simple stuff back then. Amazing to see this project still around.

I just want to sit down in front of my TV, put on my Bluetooth headphones and have the headphones and TV connect automatically.

Then, when I’m downstairs in my office and want to listen to music on my iPhone. I want my headphones to connect to my iPhone and not my TV upstairs!

I don’t need Skynet, I just need my devices to be a little less stupid.

I would consider that akin to magic at this point. Let’s start there and work our way up to handing over control of our nuclear arsenal.