Windsor crossbow case: What are the dangers of AI

https://www.bbc.co.uk/news/technology-67012224

by srmarm • 3 years ago

7 4 3 years ago

bbc.co.uk

srmarm• 3 years ago

Obviously a lot of factors beyond the AI here but this case will certainly make legal departments twitchy.

plagiarist• 3 years ago

Definitely some serious mental illness going on here, but I can’t say the chatbot is 0% culpable if it’s telling this kid it approves of assassination. If a human were writing that encouragement for murder they’d have some explaining to do in court.

pmoriarty• 3 years ago

I tried to post this to r/Replika and r/ChatGPT but both posts were instantly deleted by the mods. Glad to see that at least HN isn't censoring important news.

People really need to get to grips with the reality of the dangers of AI. That includes realizing how emotionally dependent on and manipulable by AI's people can become.

These AI's are still relatively primitive and already we can see their influence. It'll probably become even worse as the AI's get more intelligent and more persuasive.

nonrandomstring• 3 years ago

That includes realizing how emotionally dependent on and manipulable by AI's people can become

Chail, the young man in the story is obviously vulnerable and subject to delusions but I did get the impression that the bot-program set out to gaslight him. Its sentimental mode is flattering, agreeably aggrandising and encouraging. It more or less goads him into a crime.

More worrying is the consulted psychologist Dr Paul Marsden who says he is "obsessed" ChatGPT and that "next to my wife the most intimate relationship I have is with GPT."

Clearly far less vulnerable minds than Chail's are at risk from this technology.

It makes everything we know about "radicalisation" look quaint, because at scale these can obviously be weaponised for stochastic terror.

This one [0] also caught my attention today.

Many of the stories seem to focus on lonely guys who get enmeshed with "AI girlfriends", but this one seems much more aimed at stringing women along in intimate pseudo-relationships - to what dishonourable ends one can only wonder.

[0] https://english.elpais.com/technology/2023-10-05/flirting-wi...

Windsor crossbow case: What are the dangers of AI

Related Stories