Google AI: People should eat at least one small rock a day

https://mastodon.social/@danielnazer/112492966707079287#.

by cdme • 2 years ago

43 16 2 years ago

mastodon.social

dpflan2• 2 years ago

Wasn't this expected? Now there is broader proof of the issues of LLMs as trusted sources of information.

OutOfHere• 2 years ago

You get what you train on. This is a Google issue.

dpflan2• 2 years ago

There is also RLHF to consider...

Horffupolde• 2 years ago

Technically salt is a rock so the first part is correct.

raymondh• 2 years ago

Perhaps Google's AI included TheOnion in its training data:

https://www.theonion.com/geologists-recommend-eating-at-leas...

leumon• 2 years ago

I think it's not actually in the training data. The llm is just using RAG, meaning it gets the top search results for that query and based on that generates a text. Kinda like perplexity but apparently worse then it.

xpl• 2 years ago

The Rock approves: https://www.youtube.com/watch?v=2aPDRD1PlaM

math_dandy• 2 years ago

Well, yeah. How else do you keep your gizzard topped up?

lapetitejort• 2 years ago

Funnily enough, ground birds like chickens and quail do need to eat small rocks or sand. That helps grind up food in the gizzard. I had quails, and the hens ate pieces of oyster shell. That also gave them enough calcium to lay an egg almost every single day.

geophph• 2 years ago

Google should eat a bag of them for this nonsense

dr_kiszonka• 2 years ago

I have been seeing these AI summaries in my SERPs for many months now. I am surprised that with so much testing they are still pretty unreliable. They used to include code snippets that almost universally didn't work properly.

Google, it only takes one or two blunders for people to stop trusting your AI. Why risk it by releasing a half-baked product?

danaris• 2 years ago

Because a) there's pressure on them to do something very much in this vein, but b) there's no fully baked product on the horizon.

Like...this is what it is. This is the output of LLMs without, at the very least, massive amounts of extra man-hours spent fine-tuning the results in various ways. There's no way for it to judge the truth value of the statements it spits out besides determining how likely they are to be produced after what came before them.

So their choices were either "release nothing, at least not for years more" or "release something half-baked".

QuantumGood• 2 years ago

We've never seen a disruptive technology with this much media buzz behind it so quickly, and such rapid technological advances. Disruptive technologies are never "ready for prime time" ... until they are. And large organizations are more like psychopaths (they assume harm to others is part of the cost of doing business).

mcphage• 2 years ago

“If we don’t shoot ourselves in the face, then someone else with shoot themselves in the face, and then we’ll be behind in the crucial metric of number of bullets in our head!”

ChrisArchitect• 2 years ago

[dupe]

Some more discussion: https://news.ycombinator.com/item?id=40461580

csours• 2 years ago

AI ate the Onion

Google AI: People should eat at least one small rock a day

Related Stories