Pentagon officials send Anthropic best and final offer for military use of AI

https://www.cbsnews.com/news/pentagon-anthropic-offer-ai-unrestricted-military-use-sources/

by rob • 5 months ago

32 10 5 months ago

Amodei is probablyright that current models aren't reliable enough for high-stakes decisions, but the more useful question is what the failure mode looks like in practice.

thomassmith653• 5 months ago

We're in an era that presents some novel problems.

I've read a few people this week discuss the consideration that Anthropic's behavior itself will likely impact Claude's training.

The concern there is that if Claude ingests news articles that show Anthropic behaving in a manner that clashes significantly with the values they want to instill in Claude, it could make training less effective.

It's all very weird.

niemandhier2• 5 months ago

This comment is so deep, I fear to get lost in it.

If what you said was true, the only way to achieve a superior AI would be to incorporate the virtuous one is aiming at.

That would solve so many of the conundrums of the field, I wish it was true.

tim-tday• 5 months ago

Not too hard.

Dad tells kid “never harm your neighbors even when threatened by a bully”.

Bully wants dad’s help harming a neighbor. Bully threatens dad. Dad can either stand strong and live the example he wishes his child to follow, or cave displaying the opposite of what he said.

In humans what you do is far more important than what you say. You can tell a kid to tell the truth a thousand times and if you show by example that lying is ok, they will lie.

Conversely if you live a life where you simply don’t lie for any reason, your kids will learn to live honestly.

Not sure how well this translates to LLMS. Probably not cleanly.

thomassmith653• 5 months ago

If angering Trump weren't such high stakes, Anthropic could end this by releasing a single 30 second commercial.

Informing the public of this dispute would highlight Anthropic's mission (ie: responsible AI), which is a market differentiator.

The Pentagon would crawl back, anyways, since Claude is the most effective model for programming tasks.

peddling-brink• 5 months ago

The Pentagon would crawl back, anyways, since Claude is the most effective model for programming tasks.

Having not followed this closely at all, it seems like they are. If they weren’t the best, why would the Pentagon be begging like this.

rasz• 5 months ago

Informing the public

We are in an AI bubble, public doesnt drive valuations

thomassmith653• 5 months ago

I agree with the larger point you make. Most AI companies - certainly Anthropic - are private, and there's some disconnect between the money pouring into them, and their balance sheets.

That said, investors care very much about the number of users these companies have, and the public's attitude toward these companies.

An AI company can more easily raise money if they're growing their user base, and enjoy public buzz.

niemandhier2• 5 months ago

For me, Anthropics’ actions so far were the reason to lobby company internal for Claude and against Codex. I was successful, that’s going to be a few subscriptions.

Pentagon officials send Anthropic best and final offer for military use of AI

Related Stories