AI Propaganda Will Be Effective and Easily Accessible

https://techpolicy.press/ai-propaganda-will-be-effective-and-easily-accessible/

31 36 3 years ago

13years5• 3 years ago

There is still progress to be made in boosting public awareness about the unique harm derived from AI-generated propaganda. For example, several mainstream news outlets circulated the fake photos of Trump without overlaying a watermark of any kind to mitigate the potential harm that arises from the images being amplified without context – the threats these technologies pose is orders-of-magnitude greater in areas with less robust information spaces. In different information environments, such as those devoid of confidence in institutions, false evidence could have lasting repercussions before being disproven or even questioned.

How is confidence in institutions going to be helpful? There is nobody above the temptation to abuse this power. The lesson from all "trusted" institutions over recent years should be there are no trusted institutions.

AI is going to lead in societal unexpected consequences. Much of those I've elaborated in more detail here - https://dakara.substack.com/p/ai-and-the-end-to-all-things

chrisco255• 3 years ago

Yeah I don't expect institutions to get their reputations back anytime soon. But I could imagine some distributed social networks coupled with cryptographic signatures and blockchains could be used to reach consensus on some ground truth. I think this already basically happens today, albeit informally. But the deep fakes make it possible to disrupt these networks. Cryptographic signatures could at least validate sources and by minting it on-chain you get a verified timestamp of the assertion or story.

standardUser4• 3 years ago

That sounds like hyper-cynical hyperbole. For example, we trust the NY Times more than a random blog because the NYT has a long-established reputation for rarely printing inaccurate info and printing corrections when they do. And obviously it's not about trust vs no trust, it's always a matter of degrees.

13years5• 3 years ago

NYT is in the class of elite professional level bias and they certainly are not without their issues. This isn't to say they are more biased than other notable publications, but that they all have this quality and use professional language to sound authoritative on subject matters all while they still have the effect of changing opinion or manipulation of information.

https://en.wikipedia.org/wiki/List_of_controversies_involvin...

https://www.allsides.com/news-source/new-york-times

https://www.bariweiss.com/resignation-letter

https://www.theguardian.com/media/2004/may/26/pressandpublis...

All of the "trusted" sources have led us into wars and condoned the actions of bombings across the globe.

thefoolofdaath• 3 years ago

I don't think AI is bringing anything that is not on the table in terms of the basic structure of propaganda. Seeing 10% of the specific propaganda you see on the internet in numbers of 10s of news, and seeing it on 100s but still at 10% doesn't really change something. The means of production is evolving fast. I would agree to that. But there is always one secret sauce that we usually don't produce under competition that gives propaganda an edge. Think about the feeling of sincerity between traditional and social media. Nobody was sure 360p videos, 140 character tweets, etc. would replace the traditional media. People found sincere feelings combined with quick dopamine in it. Same thing here, it's not the means to an end that brings the real change. Although it is catalyzing a substantial change for sure.

boringuser2• 3 years ago

AI is able to craft the type of highly persuasive rhetoric that has literally changed the world in the past 20 years or so at scale for pennies on the dollar.

thewataccount2• 3 years ago

The difference is now there is the ability to do it at scale, and convincingly.

Bots on social media that can argue with you, share experiences, other forms of astroturfing, etc. Bots that can directly respond to your questions.

The difference IMO will be that previously making interactive propaganda was very difficult and expensive to do in a convincing manor. And also literally anyone can now ask for "a CDC article describing the dangers of [literally anything]" and have an article so convincing even diligent people won't be able to immediately recognize.

Currently unless you know what you're looking for, GPT4 is very convincing. I think even the hn crowd is already seeing bots on hn/reddit/etc and not realizing it.

TigeriusKirk• 3 years ago

This capability has been available for several years now.

In 2019, OpenAI said they couldn't fully release GPT-2 because it would be too dangerous. Now anyone can run a more powerful model.

In what ways has the predicted danger manifested in reality?

nitwit005• 3 years ago

I'm not sure how effective such bots will be. People have tried having masses of actual humans defend their country in the comments of news articles and the like. That often seems to backfire instead of help.

highduc• 3 years ago

A more complex natural language computer plugged into all social media can learn and adapt at a very high pace. If we also get it to hallucinate at at least 25fps then the whole thing can become murky. It could impersonate people on video calls and stuff along those lines. This tech looks like it will bring at least some changes in many aspects of our lives.

AstixAndBelix• 3 years ago

AI will just be like fake download buttons. Kids will instinctually learn while older people will believe anything

ethanbond• 3 years ago

Why would it be the case that LLMs will never achieve exactly-human quality writing?

There’s a reason that no purveyor of fake download buttons is worth $20B+, which is that the technology is capable of completely different things.

If this results in young people disbelieving everything, which we already see early signs of, then that’s also a loss. Probably a bigger loss than them believing the same wrong things as everyone around them.

xena• 3 years ago

It doesn't need to be perfect, it just needs to be good enough that it can fool most people. Just like a fake download button.

chpatrick• 3 years ago

Or there's so much bullshit that no one believes anything any more.

https://en.wikipedia.org/wiki/Firehose_of_falsehood

m463• 3 years ago

There will probably be a market for anti-ai checkers, just like anti-virus checkers.

(All you have to do is let them snoop on everything you say or do)

croes• 3 years ago

That's a false generalization.

You have people of all ages who fall for the oldest tricks in the book and you have people of all ages who know the medium they are using and can see behind the fake.

Just look at all these MLM videos on TikTok and YouTube and their target audience.

thepangolino• 3 years ago

Hopefully non AI propaganda will be squashed too through efforts to fight it.

amelius• 3 years ago

Can we use AI to hunt down bad forms of propaganda?

MayeulC2• 3 years ago

On one hand, that may be true. On the other hand, we may now be able to provide LLM-powered fact checkers, able to reply to every post or label them in order to slow down the dissemination of that kind of info.

Of course, authoritarian regimes will be able to do so as well, which is both a curse (much more reactive censorship) and a blessing (unlikely to understand new euphemisms or coded messages by itself).

yowzadave• 3 years ago

Yes—it seems likely that the effect will be to concentrate power/wealth in the hands of those who already have it, since they will have greater access to the more powerful AIs.

In the early days of the internet, it was easy to imagine many positive outcomes for the technology (in addition to the negatives). So far with AI, it seems like the potential negatives are much more salient in people’s imagination.

musicale• 3 years ago

There was a time when PCs seemed to democratize computing away from centralized computing services.

But the centralized services eventually came back in new forms.

Maybe Personal AI systems will change things up a bit eventually.

CatWChainsaw3• 3 years ago

And how exactly are we going to 100% remove hallucinations from the LLM powered fact checkers?

MayeulC2• 3 years ago

Who checks the fact-checkers? More LLMs (semi-seriously).

I think there is a pretty clear trend of not leveraging "trained"/"built-in" knowledge if you value accuracy, but rather use LLMs as a way to extract meaning and compare to a known-good reference.

One way would be to use LLMs to flag suspicious talking points, compile a list of propaganda topics and their rebuttal, and give that in the context window of LLMs that formulate a response.

For more general fact-checking, I guess one could ask LLMs to extract the various points, run a quick web check on them (maybe we need a "facts" database?), and examine the results. This wouldn't protect against logical fallacies though, I'm not sure that can be avoided short of injecting a proof assistant somehow (or providing rebuttals to known talking points, as suggested above).

rektide• 3 years ago

I kind of hope we start forming more personal connections bonds with people, to get more at-a-glance trustworthy views of topics aggregated from those we've come to know. And I hope we can share our social connections. Not just posts, but starting to radiate out trust & highlight each other's better (and worser) aspects more broadly across time.

The counter to propaganda & misinformation/disinformation is context. Is having better stories of who & what stories & the story-tellers are. Ultimately I think we've been ignoring for too long the backstory of who we read on line, and this new era greatly emphasizes how much more we need some kind of trust interrelationship protocol... some kind of web... of trust. ;)

HybridCurve• 3 years ago

The most terrifying aspect of this is how these models are might be trained. If the source material is very effectively crafted, you might imagine an army of agents with cult leader like eloquence indoctrinating the weak of mind. Combine this with politically subversive motivations and you have serious threat to societies where the governments do not exert control of people with force.

In the past, it was difficult to disseminate disinformation since it was often planted in newspapers and such in other nations rather in the US. At some point this information might make it's way into our information ecosystem years later (false narrative that the US created HIV for example). The internet and social media has already changed that. Now disinformation flows instantaneously across borders, even finding unethical organizations which eagerly acts as clearing houses for this toxic content. We still have not successfully adapted to this crisis.

The reality is we have less than a few years to excise the already existing disinformation laundering networks, reinforce our information ecosystems, and educate the public. All this needs to be accomplished before addressing the imminent threat that malign language models pose in the immediate future. This is not only threat from abroad by hostile states but also from powerful self-serving organizations within our nations which might supplant democracy with a domestic brand of authoritarianism.

With people like Peter Thiel and Elon Musk bankrolling OpenAI, it's not looking good.

CatWChainsaw3• 3 years ago

Let's move fast and break things/society instead.

euroderf• 3 years ago

I guess the days of boutique propaganda are numbered. sigh

AI Propaganda Will Be Effective and Easily Accessible

Related Stories