How AI destroys institutions

https://cyberlaw.stanford.edu/publications/how-ai-destroys-institutions/

by JeanKage • 6 months ago

305 252 6 months ago

cyberlaw.stanford.edu

chrisjj11• 6 months ago

True title: How AI Destroys Institutions

PaulHoule4• 6 months ago

"How" automatically gets chopped off as a prefix for HN submissions although you can usually edit and put it back.

chrisjj11• 6 months ago

Indeed. Crazy, esp. given the guidelines say "please use the original title".

PaulHoule4• 6 months ago

I would say "Civic institutions function in ways that degrade and are likely to destroy ... civic institutions"

inanutshellus2• 6 months ago

Cute, but that's an ineffective belittlement of his argument, not only because it's irrelevant but because he covers that even in the abstract:

Purpose-driven institutions [...] empower individuals to take intellectual risks and challenge the status quo.

(which of course includes and is most-often the institution itself.)

PaulHoule4• 6 months ago

I'll argue otherwise.

Almost the defining problem of modern institutions is sweeping problems under the rug, be it be climate change or (most important) Habermas's "Legitimation Crisis" [1] It's something I've been watching happen at my Uni ever since I've had anything to do with it. The spectacle of institutions failing to defend themselves [2] turns people against them.

Insofar as any external threat topples an institution or even threatens it seriously there was a failure of homeostasis and boundaries from the very building.

[1] https://en.wikipedia.org/wiki/Legitimation_Crisis_(book)

[2] ... the king is still on the throne, the pound is still worth a pound ...

21asdffdsa12• 6 months ago

No, it does not. It preserves them as they where. Spreading of cultures that can not build institutions and uphold the rule of law does. To which stanford contributed considerately. The faction that can not build a working economic system and yearns to rule the economic system, is also incapable to build working societies, institutions and rule of law.

SecretDreams2• 6 months ago

Did you read the article?

hoppyhoppy2• 6 months ago

Please don't comment on whether someone read an article. "Did you even read the article? It mentions that" can be shortened to "The article mentions that".

https://news.ycombinator.com/newsguidelines.html

alwayseasy2• 6 months ago

It feels like you didn't read or even skim the full article and instead are just reacting to the title.

squeefers4• 6 months ago

feels like you think social media is bad for other people but not you. every single one of you is posting on social media right now, whilst making the case its evil or a problem or bad or some negative descriptor. people who think its only bad for kids are quick to bring porn up, but that issue is itself an emotional reaction. remember when prior to the 1950s they said homosexuality was bad for mental health then once it became socially acceptable, there was suddenly "evidence" to the contrary.

uptownJimmy• 6 months ago

All scams are inherently destructive. Everything else is co-morbidity.

alwayseasy2• 6 months ago

Note this is the asbtract, so please let's not debate the abstract...

The link to download the paper is here: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5870623

rpdillon4• 6 months ago

I already debated this on HN when this was posted two days ago, but this paper is not peer-reviewed and is a draft. The examples it uses of DOGE and of the FDA using AI are not well researched or cited.

Just as an example, they criticize the FDA for using an AI that can hallucinate whole studies, but they don't talk about the fact that it's used for product recalls, and the source that they use to cite their criticism is an Engaget article that is covering a CNN article that got the facts wrong, since it relied on anonymous sources that were disgruntled employees that had since left the agency.

Basically what I'm saying is the more you dig into this paper, the more you realize it's an opinion piece.

bayindirh• 6 months ago

This is what drafts for. It's either a very rough draft with some errors and room for improvement, or a very bad draft sitting on the wrong foundation.

Either way, it's an effort, and at least the authors will learn to not to do.

tucnak3• 6 months ago

Not only it's an opinion piece disguised as scientific "Article" with veneer of law, it has all the hallmarks of quackery: flowery language full of allegory and poetic comparisons, hundreds of superficial references from every area imaginable—sprinkled throughout, including but not limited to—Medium blog posts, news outlets, IBM one-page explainers, random sociology literature from the 40's, 60's and 80's, etc.

It reads like a trademark attorney—turned academic got himself interested in "data" and "privacy," wrote a book about it in 2018, and proceeded to be informed on the subject of AI almost exclusively by journalists from popular media outlets like Wired/Engaget/Atlantic—to bring it all together by shoddily referencing his peers at Harvard and curiously-sounding 80's sociology. But who cares as long as AI bad, am I right?

chrisjj11• 6 months ago

an Engaget article that is covering a CNN article that got the facts wrong, since it relied on anonymous sources that were disgruntled employees that had since left the agency.

Disgruntled doesn't mean inaccurate.

randusername• 6 months ago

Institutions like higher education, medecine, and law inform the stable and predictable patterns of behavior within organizations such as schools, hospitals, and courts., respectively,, thereby reducing chaos and friction.

Hard to take seriously with so many misspellings and duplicate punctuation.

I vibe with the general "AI is bad for society" tone, but this argument feels a lot to me like "piracy is bad for the film industry" in that there is no recognition of why it has an understandable appeal with the masses, not just cartoon villains.

Institutions bear some responsibility for what makes AI so attractive. Institutional trust is low in the US right now; journalism, medicine, education, and government have not been living up to their ideals. I can't fault anyone for asking AI medical questions when it is so complex and expensive to find good, personalized healthcare, or for learning new things from AI when access to an education taught by experts is so costly and selective.

omnicognate• 6 months ago

Hard to take seriously with so many misspellings and duplicate punctuation.

Very bad writing, too, with unnecessarily complicated constructions and big words seemingly used without a proper understanding of what they mean (machinations, affordances).

wendgeabos2• 6 months ago

The title makes me disinclined to read the whole paper. But I guess that's AI destroying institutions. Sigh. Social science != science.

PlatoIsADisease3• 6 months ago

If you really want to traumatize yourself, learn about Scientific Realism vs Instrumentalism. (And further reading, Early Wittgenstein, but know you are only going to understand 10% of it, but that's okay, everyone only understands 10% of it)

If you want to further freak yourself out about probability look up Bertrand's Paradox and The Problem of Priors.

Yes Social Science is less accurate than what people call hard science, but the edges of scientific systems should concern yourself of validity of even hard science. Its pragmatically useful, yes, but metaphysical Truth? No.

wendgeabos2• 6 months ago

I do, and I have. Whereof man cannot speak, thereof he must pass over in silence, to which I say, pbthbptltpt! I hold with the primacy of doubt fer shure.

reedf12• 6 months ago

In other words: the penny finally dropped for lawyers. The next decade will be every knowledge field actively conspiring against AI.

FromTheFirstIn2• 6 months ago

Ah yes, it’s not an earnest critique that the tech is destabilizing and isolating. It’s a conspiracy! Thank you. For a moment there I thought I’d have to examine my own beliefs!

philipallstar• 6 months ago

Sounds like you probably highly resist examining them.

reedf12• 6 months ago

This type of reflexive snark is just shite; I'm so bored of it. Things can be both earnest and compelled - right? I agree with you, and still hold my opinion.

bogzz• 6 months ago

Awesome.

Applejinx2• 6 months ago

Where appropriate. For instance, the purpose of lawyers is to serve and propagate the law, as distinct from 'most people say'. Justice in general is meant, imperfectly, to strive for correct answers on the highest possible level, even and especially if new accepted case law serves to contradict what was put up with before.

So, web programmers could be going against AI on the grounds of self-preservation and be wholly justified in doing so, but lawyers are entitled to go after AI on more fundamental, irreconcilable differences. AI becomes a passive 'l'estat, cest moi' thing locking in whatever it's arrived at as a local maximum and refusing to introspect. This is antithetical to law.

DrScientist• 6 months ago

For instance, the purpose of lawyers is to serve and propagate the law

But day to day, they spend a lot of their time selling boiler plate contracts and wills or trying to smuggle loopholes into verbose contracts, or trying to find said holes in said contracts presented by a third party[1]

Or if they are involved in criminal law, I suspect they spend most of their time sifting the evidence and looking for the best way to present it for their client - and in the age of digital discovery the volume of evidence is overwhelmning.

And in terms of delivering justice in a criminal case - isn't that the role of the jury ( if you are lucky enough still to have one ).

I suspect very few lawyers ever get involves in cases that lead to new precedents.

dooglius2• 6 months ago

I believe an attorney is considered obligated to give a client the best possible defense (with limits as to ethics), which is definitely contrary to serving and propagating the law

code512• 6 months ago

12 Angry Agents

diablozzq• 6 months ago

The immediate hot take is even if correct, the paper is largely opinion piece wrapped in an academic paper with Stanford logo.

Most of the sections had no citations and anecdotes.

Like many who have predicted doom or ChatGPT can never do XYZ, anecdotes do not build a substantive argument.

mahoho• 6 months ago

...What? Like half of the vertical length of the paper is footnotes with citations. Also, opinions are kind of an important part of how we get ideas.

rafaelbeirigo• 6 months ago

This is a byproduct of every revolution.

Forgeties796• 6 months ago

Most revolutions have historically resulted in a lot of death and little change for the better if any. Frequently the outcome is worse than before.

nisegami• 6 months ago

Forest fires are immensely destructive, but they clear the way for new growth in their wake. The same has been said for recessions and the economy, and I think there's at least some comparison to be made for revolutions and societies.

thatguy0900• 6 months ago

Nah this revolution the billionaires who control the Ai and automated means of production will voluntarily give their money to the little guy instead of needing widespread unrest and riots beforehand like the other times

toddmorey2• 6 months ago

Right you are. Nature can be violent, but prefers gradual change. Abrupt change shocks ecosystems and always comes with unintended consequences.

bethekidyouwant• 6 months ago

What is your short list of changes that have resulted in life and betterment?

Are we only talking about technological revolutions here or are you talking about peasants uprising in China 1000 years ago?

PlatoIsADisease3• 6 months ago

The Copernican Revolution (discovery earth was not at the center of the solar system) initially had worse empirical calculations because they didn't know planets traveled in ellipses.

The moments after the revolution might be worse, but in the long term, we got better.

toddmorey2• 6 months ago

I struggle with the thesis that our institutions haven't already been fatally wounded. Social media and endless content for passive consumption have already errored the free press, short-circuited decision-making, and isolated people from each other.

squeefers4• 6 months ago

Social media and endless content for passive consumption

neither being able to speak to someone on a computer nor videos on the internet are new, fancy web 10.0 frontend notwithstanding

and isolated people from each other.

I assume you mean doomscrolling as opposed to the communication social media affords. because social media actually connects us (unless apparently its facebook, then messaging is actually bad)

harimau777• 6 months ago

I'm not sure what you mean. The internet itself is new let alone widespread access to video sharing.

Part of the problem is that social media isn't social media anymore. Its an algorithmic feed that only occassionally shows content from people you're friends with. If Facebook went back to its early days when it was actually a communication tool, then I don't think you would see the same complaints about it.

wat100002• 6 months ago

Most social media isn't about communication, it's about engagement bait. Most usage consists of popular accounts sending messages, then people writing replies that are never read by the original account, and some vapid argument or agreement among the replies. It essentially pretends to connect us while actually capturing our attention away from that connection.

littlemerman• 6 months ago

Title should be updated to “How AI Destroys Institutions” to match source

world2vec• 6 months ago

HN auto-removes "How" from the titles.

buellerbueller• 6 months ago

dang, this submission title should be amended.

JFC downvoters; when I posted this comment the title did not match the article title.

6DM• 6 months ago

I don't think AI is the cause, it's merely the mechanism that is speeding up what has already been happening.

Social media was already isolating people. It is being sped up by the use of AI bots (see dead internet theory). These bots are being used to create chaos in society for political purposes, but overall it's increasingly radicalizing people and as a result further isolating everyone.

AI isn't eroding college institutions, they were already becoming a money grab and a glorified jobs program. Interpersonal relationships (i.e. connections) are still present, I don't see how AI changes that in this scenario.

I am not a fan of how AI is shaping our society, but I don't place blame on it for these instances. It is in my opinion that AI is speeding up these aspects.

The article does highlight one thing that I do attribute to AI and that is the lack of critical thinking. People are thinking less with the use of AI. Instead of spending time evaluating, exploring and trying to think creatively. We are collectively offloading that to AI.

echelon• 6 months ago

100% correct in the first part, though I'd like to think there's a bimodal effect with AI users and usage.

Hard working expert users, leveraging AI as an exoskeleton and who carefully review the outputs, are getting way more done and are stronger humans. This is true with code, writing, and media.

People using AI as an easy button are becoming weaker. They're becoming less involved, less attentive, weaker critical thinkers.

I have to think that over some time span this is going to matter immensely. Expert AI users are going to displace non-AI users, and poor AI users are going to be filtered at the bottom. So long as these systems require humans, anyway.

Personally speaking:

My output in code has easily doubled. I carefully review everything and still write most stuff by hand. I'm a serious engineer who built and maintained billion dollar transaction volume systems. Distributed systems, active active, five+ nines SLA. I'm finding these tools immensely valuable.

My output in design is 100% net new. I wasn't able to do this before. Now I can spin up websites and marketing graphics. That's insane.

I made films and media the old fashioned way as a hobby. Now I'm making lots of it and constantly. It's 30x'd my output.

I'm also making 3D characters and rigging them for previz and as stand-ins. I could never do that before either.

I'm still not using LLMs to help my writing, but eventually I might. I do use it as a thesaurus occasionally or to look up better idioms on rare occasion.

nathan_compton• 6 months ago

I have observed this with students. Some use AI to really extend their capabilities and learn more, others become lazy and end up learning less than if they hadn't used AI.

nautilus12• 6 months ago

I don't think this argument makes much sense. If you are running down hill towards a cliff then saying that adding a cart to speed up the process doesn't give the cart moral blameworthiness is an unhelpful observation. You can still chose to stop running down the hill or to not get on the cart.

sodapopcan• 6 months ago

Exactly! Was going to make a similar comment if I didn't already see one. People keep saying things like this and drives me fuckin' nuts. It's not that there are no positives but I don't see how the positives outweigh the negatives.

greenavocado• 6 months ago

Dead internet theory original post: https://forum.agoraroad.com/index.php?threads/dead-internet-...

mock-possum2• 6 months ago

Man I had forgotten how batshit conspiracy theory that was

Angostura• 6 months ago

I rather disagree with this position.

To risk an analogy, if I throw petrol onto an already smouldering pile of leaves, I may mot have ‘caused’ the forest fire, but I have accelerated it so rapidly that the situation becomes unrecognisable.

There may already have been cracks in the edifice, but they were fixable. AI takes a wrecking ball to the whole structure

basilgohar• 6 months ago

I agree and disagree with parts of what you said.

AI may have caused a distinct trajectory of the problem, but the old system was already broken and collapsing. If the building falls over or collapses in place doesn't change that the building was already at its end.

I think the fact that AI is allowed to go as far as it has is part of the same issue, namely, our profit-at-all-costs methodology of late-stage capitalism. This has lead to the accelerated destruction of many institutions. AI is just one of those tools that lets us sink more and more resources into the grifting faster.

(Edit: Fixing typos.)

booleandilemma• 6 months ago

I agree with this. We've made existing problems 100x worse overnight. I just read the curl project is discontinuing bug bounties. We're losing so much with the rise of AI.

gosub100• 6 months ago

or, having a glass of wine with dinner or a few beers on the weekend is fine. but drinking a 6-pack per day or slamming shots every night is reckless and will lead to health consequences.

ajb• 6 months ago

This is fair as a criticism of the leading AI companies, but there's a catch.

When you attribute blame to technologies, you make it difficult to use technologies in the construction of a more ethical alternative. There are lots of people who think that in order to act ethically you have to do things in an artisanal way; whether it's growing food, making products, services, or whatever. The problem with this is that it's outcompeted by scalable solutions, and in many cases our population is too big to apply artisanal solutions. We can't replace the incumbents with just a lot of hyper-local boutique businesses, no matter how much easier it is to run them ethically. We have to solve how to enable accountability in big institutions.

There's a natural bias among people who are actually productive and conscientious, which is that an output can only be ethical if it's the result of personal attention. But while conscientiousness is a virtue in us as workers, it's not a substance that is somehow imbued in a product, if the same product is delivered with less personal attention then it's just as good - and much cheaper and therefore available to more people, which is the product is good for them, makes it more ethical and not less.

(I'm making a general point here. It's not actually obvious to me that AI is an essential part of the solution either)

mock-possum2• 6 months ago

I suppose to belabor the analogy, its still not the petrol’s fault - the same fuel is also used to transport firefighting resources, in fact, a controlled burn might have effectively mitigated the risk of a forest fire in the first place. Who left those leaves to smolder in the first place, anyway? Why’d you throw petrol on the pile?

You just have to be careful not to say “this is AI’s” fault - it’s far more accurate, and constructive, to say “this is our fault, this is a problem with the way some people choose to use LLMs, we need to design institutions that aren’t so fragile that a chatbot is all it takes to break them.”

jrjeksjd8d2• 6 months ago

Capitalism is destroying institutions. Any new technology must be employed in service of "number go up". In this system externalities have to be priced in with taxes, but it's cheaper to buy off legislators than to actually consider the externalities.

This is how we get food that has fewer nutrients but ships better, free next-day delivery of plastic trash from across the world that doesn't work, schools that exist to extract money rather than teach, social media that exists primarily to shove ads in your face and trick you into spending more time on it.

In the next 4 years we will see the end of the American experiment, as shareholder capitalism completely consumes itself and produces an economy that can only extort and exploit but not make anything of value.

jongjong3• 6 months ago

It's not capitalism, it's the monetary system that's the problem. It's not a level playing field. Capitalism requires a fair monetary system as a precondition. Though I can agree that communism would be better than whatever perverse system we have now.

PlatoIsADisease3• 6 months ago

Capitalism is destroying institutions.

What year do you think was the first year of capitalism? Depending on your starting point, it caused the American Revolution and French Revolution.

It caused destruction of monarchy.

vixen99• 6 months ago

I'll focus just on food here: people do have a choice. I don't live in the US but is it impossible to buy basic ingredients, fruit, vegetables, grains, meat whatever etc., and actually cook something? Eating this kind of food you can even stack your life chances more in your favor. Huge amounts of information abound as to the how you can do that. Consumers, if they are free to choose, determine value and entrepreneurs will respond. It can be profoundly distorted, that's true but at base, capitalism is doing something that someone else finds of value or not.

syawaworht• 6 months ago

I think the wrong lesson to draw for this is that it's just a systems problem. Somehow if we do a different song and dance, the outcome will be different. I've been thinking that the end state of capitalism and communism are not that different - what is the difference between wealth that you can't spend in a million lifetimes and "no" wealth at all? The endpoint is the same, the game becomes about relative power over others, in service of an unending hunger.

Capitalism is the manifestation of the aggregate human psyche. We've agreed that this part of our selves that desires to possess things and the part that feels better when having even more, is essential. This is the root we need to question, but have not yet dared to question. Because if we follow this path of questioning, and continue to shed each of our grasping neuroticisms, the final notion we may need to shed is that we are people, individual agents, instead of nonseparate natural phenomena.

We will have to confront that question eventually because we will always have to face the truth.

pas4• 6 months ago

That's not capitalism. That's human nature. We want a better future.

Capitalism assigns a price to this, makes it more efficient. (By allowing people to buy/rent productive things (land, machines) hire people, and buy unproductive setups, improve it, and earn a profit on the effect of the improvement itself.)

If you think "shareholder capitalism" overplayed this, well, maybe, but it seems that manufacturing is getting fucked by tariffs, construction is getting fucked by NIMBYism, and ultimately the world is getting fucked by lack of improvements, by standing still, by regressing to a past that never was despite the costs, and not because people want to make number go up!

Of course there's a ton of problems with power concentration everywhere, but market liberalism correlates with liberty and well-being, and the solution is not USSR-style denial of markets (and in general, behavioral-, and micro- and macroeconomics), it's understanding them, and using taxes to help people to participate in them.

palmotea• 6 months ago

I don't think AI is the cause, it's merely the mechanism that is speeding up what has already been happening.

I think the technical term is "throwing gas on the fire." It's usually considered a really bad thing to do.

I am not a fan of how AI is shaping our society, but I don't place blame on it for these instances. It is in my opinion that AI is speeding up these aspects.

If someone throws gas on a fire, you can totally blame them for the fire getting out of control. After all, they made it much worse! Like: "we used to have smouldering brush fire that we could put out, but since you dumped all that gas on it, now we will die because we have a forest fire raging all around us."

jongjong3• 6 months ago

Yes of course AI is just a symptom. The cause is the fiat monetary system. In all history, no fiat monetary system has ever lasted. There have been hundreds. They always fail eventually and lead to the collapse of nations and empires.

godelski• 6 months ago

While I agree with a lot of what you said, your comment implies catalysts and accelerants don't matter.

The roots of the problem are very real and very complex but forcing them to be addressed quickly throws people into panic mode and frankly that leads to sloppy solutions that are going to cause the cycle to repeat (though will temporarily solve some problems, and this is far better than nothing).

  > We are collectively offloading that to AI.

Frankly, this is happening because so many are already in that panicked stressed mode (due to many factors, not just social media). It's well know people can't think critically under high stress. AI isn't the cause of that stress but it sure is amplifying many of them

pyeri• 6 months ago

If bots are being used to create chaos in society, it really isn't possible that the platforms themselves are just innocent bystanders here. It is technically possible and quite easy for the platforms to block bots if they really wanted to, in fact it's actually in their best interest to have human only organic activity as it increases the platform's credibility and reduces network cost. If they're still letting bots operate and actually post content on their platforms, they're likely in cahoots with the politicians.

anonymars3• 6 months ago

Honestly, I know I'm going to sound off my rocker but thinking of e.g. Mass Effect or The Matrix, are we watching ourselves getting evolved/replaced in real time?

All of existence has been a to-and-fro of larger organisms emerging by connecting and subsuming smaller ones. Organelles, cells, organisms... Are we creating the instruments of our own ascension (fancy calculators) or are we doomed to watch AI and the internet manipulate and supersede us?

johnnyanmac11• 6 months ago

I am not a fan of how AI is shaping our society, but I don't place blame on it for these instances. It is in my opinion that AI is speeding up these aspects.

I'll use a rather extreme example here, but this sounds a bit like "Heroin addiction is just speeding up aspects that society already does. It's so easy to get addicted to smoking cigarettes".

Sometimes the catalyst is the problem, even if it's not the only problem. In this case I think placing some guardrail on both social media and AI is worthwhile.

IvanK_net• 6 months ago

Can anybody prove that the essay and the abstract was not written by the AI, using 20 to 50 words as a prompt?

Applejinx2• 6 months ago

Of course not, it's expressing widely held observations that have been out there in the human population for a long time, and they're correct observations so they're hardly impossible to find.

It's not really a good argument to say 'but what if this argument is so right and so commonly held that an AI could regurgitate it?'. Well, yes, because AI is not inherently unable to repeat correct opinions. It's pretty trivial to get AI to go 'therefore, I suck! I should be banned'. What was it, Gemini, which took to doing that on its own due to presumably the training data and guidance being from abused and abusive humans?

throwaw123• 6 months ago

Civic institutions - the rule of law, universities, and a free press - are the backbone of democratic life

It probably was in 1850-1950s, but not in the world I live today.

Press is not free - full of propaganda. I don't know any journalist today I can trust, I need to check their affiliations before reading the content, because they might be pushing the narrative of press owners or lobbies

Rule of law? don't make me laugh, this sounds so funny, look what happened in Venezuela, US couldn't take its oil, so it was heavily sanctioned for so many years, then it still couldn't resist the urge to steal it, and just took the head of the state.

Universities - do not want to say anything bad about universities, but recently they are also not good guys we can trust, remember Varsity Blues scandal? https://en.wikipedia.org/wiki/Varsity_Blues_scandal - is this the backbone of democratic life?

freejazz• 6 months ago

Press is not free - full of propaganda

Did you think that was different from 1850-1950?

throwaw123• 6 months ago

I don't think, but I feel like situation was slightly better for some reasons:

* there were no internet, so local communities strived to inform things happening around more objectively. Later on, there were no need for local newspapers

* capitalism was on the rise and on its infancy, but families with a single person working could afford some of the things (e.g. house, car) hence there were no urgent need to selling out all your principles

* people relied on books to consume information, since books were difficult to publish and not easy to revert (like removing a blog post), people gave an attention to what they're producing in the form of books, hence consumers of those books were also slightly demanding in what to expect from other sources

* less power of lobby groups

* not too many super-rich / billionaires, who can just buy anything they want anytime, or ruin the careers of people going against them, hence people probably acted more freely.

But again, can't tell exactly what happened at that time, but in my time press is not free. That's why I said "probably"

zdc1• 6 months ago

My (non-authoritative) understanding was that after Vietnam there was a more recognised need to control what the media published, resulting in Operation Mockingbird and such. However, given how centralised the media has always been, I could see it being influenced before this.

Did you have any examples or reading to share?

YetAnotherNick• 6 months ago

Yes, at the very least there wasn't strong polarization, so the return on propaganda content is lower. Now a newspaper risk losing their consumer more if they publish anything contrarian.

[1] https://www.vox.com/2015/4/23/8485443/polarization-congress-...

biophysboy3• 6 months ago

The alternative to all of these institutions is currently social media, which is worse by any metric: accuracy, fairness, curiosity, etc.

I am more optimistic about AI than this post simply because I think it is a better substitute than social media. In some ways, I think AI and institutions are symbiotic

qcnguy3• 6 months ago

It's better in all those metrics.

Go on X. Claims are being fact checked and annotated in real time by an algorithm that finds cases where ideologically opposed people still agree on the fact check. People can summon a cutting edge LLM to evaluate claims on demand. There is almost no gatekeeping so discussions show every point of view, which is fair and curious.

Compare to, I dunno, the BBC. The video you see might not even be real. If you're watching a conservative politician maybe 50 minutes were spliced out of the middle of a sentence and the splice was hidden. You hear only what they want you to hear and they gatekeep aggressively. Facts are not checked in real time by a distributed vote, LLMs are not on hand to double check their claims.

AI and social media are working well together. The biggest problem is synthetic video. But TV news has that problem too, it turns out. Just because you hear someone say some words doesn't mean that was what they actually said. So they're doing equally badly in that regard.

johnnyanmac11• 6 months ago

I am more optimistic about AI than this post simply because I think it is a better substitute than social media. In some ways, I think AI and institutions are symbiotic

If I made a pitch for a cyberpunk dystopia where knowledge is centralized by a for-profote corporate trillionaire, I'd get a resounding yawn for originality. Yet here we are vouching for that in real time.

Social media has a lot of noise, but people understand not to take poisonshadow_42 as a central hub of general knowledge. That is sadly not the case with Grok, despite its obvious, blatant abuse of such a title.

techblueberry3• 6 months ago

Paradoxically, these institutions are probably the best they've ever been. We trusted them more 100 years ago because we didn't know better, but we're now letting perfect be the the enemy of good. Wise men once said:

"In prison, I learned that everything in this world, including money, operates not on reality..."

"But the perception of reality..."

Our distrust of institutions is a prison of our own making.

mitthrowaway2• 6 months ago

I can't speak for the other institutions but I'd be shocked if the press, as an institution, is the best it's ever been. I know a lot of people who left that industry because of the way that the Internet and social media eroded the profitability of reporting while pushing on virality, articles were tuned to declining attention spans, outlets leaned more on centralized newswire services, and local reporting collapsed nearly to zero.

mbesto• 6 months ago

If this is all true (I don't disagree) than what is or should be the backbone of democratic life?

wongarsu• 6 months ago

They are (part of) the backbone of democratic life. But democratic life hasn't been doing well in the US in the last decades. The broken backbone is both cause and symptom of this in a vicious cycle

raw_anon_1111• 6 months ago

The press has never been believable. How many innocent people were beat, framed and shot and the press just took the word of the police? Rappers in the 80s were talking about police brutality. But no one believed them until the Rodney King video in 1992. Now many don’t instinctively trust the police because everyone has a camera in their pocket and publish video on social media.

On the other side of the coin, the press and both parties ignored what was going on in rural America until the rise of Trump

mghackerlady2• 6 months ago

These are all supposed to be the backbone of democratic life, yes, but won't someone PLEASE think of the shareholders?!?

ranger207• 6 months ago

The press has always been full of propaganda, it's just that in the time period 1850-1950 there weren't any dissenting media outlets so it was impossible for anyone to recognize that there was anything different from the propaganda

Every society is going to have problems. Democracy's benefit is that it allows those problems to be freely discussed and resolved

mrfumier• 6 months ago

Venezuela, US couldn't take its oil, so it was heavily sanctioned for so many years, then it still couldn't resist the urge to steal it, and just took the head of the state.

Could you provide supporting evidence for your statement?

johnnyanmac11• 6 months ago

do not want to say anything bad about universities

I'll make a slightly warm take: Co-opting our higher education institutions to be used as an extended job pipelne was a huge mistake. Your primary goal for attending college should not be to prepare for a job unless you are aiming for a highly specialized position.

Hotter take: jobs above a certain size should require a 3 month onboarding pipeline that is demonstrably used if they want to make the argument of hiring H1-B's. If you can learn the job in that period, it's clear that there is domestic talent.

jvanderbot• 6 months ago

It's hard for me to argue with these few direct sentences.

    They delegitimize knowledge, inhibit cognitive development, short circuit
    decision-making processes, and isolate humans by displacing or degrading human connection.
    The result is that deploying AI systems within institutions 
    immediately gives that institution a half-life.

... even if we don't have a ton of "historical" evidence for AI doing this, the initial statement rings true.

e.g., an LLM-equipped novice becomes just enough of an expert to tromp around knocking down chesterton's fences in an established system of any kind. "First principles" reasoning combined with a surface understanding of a system (stated vs actual purpose/methods), is particularly dangerous for deep understanding and collaboration. Everyone has an LLM on their shoulder now.

It's obviously not always true, but without discipline, what they state does seem inevitable.

The statement that AI is tearing down institutions might be right, but certainly institutions face a ton of threats.

rpdillon4• 6 months ago

The examples that the paper cites that are historical are not compelling, in my opinion.

The authors use Elon Musk's DOGE as an example of how AI is destructive, but I would point out that that instance was an anomaly, historically, and that the use of AI was the least notable thing about it. It's much more notable that the richest man in the world curried favor by donating tens of millions of dollars to a sitting US president and then was given unrestricted access to the government as a result. AI doesn't even really enter the conversation.

The other example they give is of the FDA, but they barely have researched it and their citations are pop news articles, rather than any sort of deeper analysis. Those articles are based on anonymous sources that are no longer at the agency and directly conflict with other information I could find about the use of that AI at the FDA. The particular AI they mention is used for product recalls and they present no evidence that it has somehow destroyed the FDA.

In other words, while the premise of the paper may seem intellectually attractive, the more I have tried to validate their reasoning and methodology, the more I've come up empty.

OgsyedIE• 6 months ago

The natural process of creative destruction deterritorializes everything, that's how every advance in history has always came about. The apparent difference perceived here is merely that this time, the human capital in the institutions that's supposed to reinvent the institutions alongside each new development are struggling.

Coincidentally, this has happened exactly when the Flynn effect reverted, the loneliness epidemic worsened, the academics started getting outnumbered by the deans and deanlings and the average EROI of new coal, oil and gas extraction projects fell below 10:1. Sure, we should be wary of the loss to analysis if we just reduce everything to an omnicause blob, but the human capital decline wouldn't be there without it.

blfr• 6 months ago

I am skeptical of hypotheses like this when the deterioration has begun before its supposed cause. This is how I look at social media or tinder being blamed for loneliness or low fertility. While they may have exacerbated the issues, trends have been unfavorable for decades if not centuries before.

Similarly, it seems to me like the rule of law (and the separation of powers), prestige press, and universities are social technologies that have been showing more and more vulnerabilities which are actively exploited in the wild with increasing frequency.

For example, it used to be that rulings like Wickard v. Filburn were rare. Nowadays, various parties, not just in the US, seem to be running all out assaults in their favoured direction through the court system.

johndhi2• 6 months ago

Sorry to be this person, but I don't really agree with the first sentence:

--> "Civic institutions—the rule of law, universities, and a free press—are the backbone of democratic life."

People are the backbone of our civilization. People who have good intentions and support one another. We don't NEED an FDA to function -- it's just a tool that has worked quite well for a long time for us.

AnimalMuppet• 6 months ago

The problem is that not all people have good intentions. That's why we actually need the FDA, or something like it.

johndhi2• 6 months ago

There are a lot of tools to address the problem that some people have bad intentions.

We publish common sense laws, and we have police officers and prosecutors, and then we have a court system to hold people accountable for breaking the law. That's one pretty major method that has little to do with the need for an institution like FDA.

I don't know if a system that relied entirely on tort and negligence and contract law to protect people from being sold snake oil would function better or worse than FDA, but I do know something like FDA (where a bunch of smart people advise very specifically on which drugs are ok to take and which are not) isn't the only option we have.

rapatel0• 6 months ago

More social science academic nonsense.

Fun quotes from the paper > I. Institutions Are Society’s Superheroes: Institutions are essential for structuring complex human interactions and enabling stable, just, and prosperous societies.

Institutions like higher education, medecine, and law inform the stable and predictable patterns of behavior within organizations such as schools, hospitals, and courts., respectively,, thereby reducing chaos and friction.
Similarly, journalism, as an institution, commits to truth-telling as a common purpose and performs that function through fact-checking and other organizational roles and structures. Newspapers or other media sources lose legitimacy when they fail to publish errata or publish lies as news.
Attending physicians and hospital administrators may each individually possess specific knowledge, but it is together, within the practices and purposive work of hospitals, and through delegation, deference, and persistent reinforcement of evaluative practices, that they accomplish the purpose of the institution
The second affordance of institutional doom is that AI systems short- circuit institutional decisionmaking by delegating important moral choices to AI developers.
Admittedly, our institutions have been fragile and ineffective for some time.36 Slow and expensive institutions frustrate people and weaken societal trust and legitimacy.37 Fixes are necessary.
The so-called U.S. “Department of Government Efficiency” (“DOGE”) will be a textbook example of how the affordances of AI lead to institutional rot. DOGE used AI to surveil government employees, target immigrants, and combine and analyze federal data that had, up to that point, intentionally been kept separate for privacy and due process purposes.

It's all politics. 150% bullshit.

gbanfalvi2• 6 months ago

I think the paper is really good and makes loads of valid points... and it's kinda terrifying.

Having super accessible machines that can make anything up and aren't held accountable run the world is going to break so many systems where truth matters.

pizzafeelsright• 6 months ago

Having super accessible machines

Having large bureaucratic organizations

that can make anything up and aren't held accountable

that run everything and aren't held accountable

run the world is going to break so many systems

run the world breaking up families, freedom, and fun

where truth matters.

where truth is determined by policy

gbanfalvi2• 6 months ago

Having large bureaucratic organizations

Yes, that's what the paper argues. Institutions at every scale (say, doctor's clinics, hospitals, entire healthcare systems) are very challenging to access compared to me asking ChatGPT. And it's not just the bureaucracy, but there's time, money and many other intangible costs associated with interacting with institutions.

[Large bureaucratic organizations]that run everything and aren't held accountable

But they ultimately are. People from all types of institutions are fired and systems are constantly reorganized and optimized all the time. Not necessarily for the better -- but physical people are not black boxes spewing tokens.

Individuals' choices are ultimately a product of their knowledge and their incentives. An MLM's output is the result of literal randomness.

run the world breaking up families, freedom, and fun

There's lots of terrible institutions vulnerable to corruption and with fucked up policies, but inserting a black box into _can't_ improve these.

where truth is determined by policy

The truth is the truth. Regardless of what policy says. The question is, do you want to be able to have someone to hold accountable or just "¯\_(ツ)_/¯ hey the algorithm told me that you're not eligible for healthcare"

zinodaur• 6 months ago

I firmly believe "AI will be used by the psycho weasel billionaires to torture us all", but this article is weak. It seems like it was written by people too scared of AI to use it. They have a couple of points you realize in your first month of using AI, and they wrap them in paragraphs of waffle. I wish the anti AI camp was more competent

onaclov2000• 6 months ago

I think that as communities spread (as with increased joining of online communities) we lost much in our local communities, this feels to me like a sort of extension of that, it's a community of one (well kinda, it's a sum of communities, and kinda missing the bidirectional communication, of the community) maybe?

notjes• 6 months ago

"Civic institutions—the rule of law, universities, and a free press" All of those are rotten and corrupted to the core. But I don't think they will be destroyed by AI. People are voting with their feet.

embedding-shape2• 6 months ago

This has had a large discussion already just five days ago, with ~160 comments: https://news.ycombinator.com/item?id=46644779

FuturisticLover• 6 months ago

"Isolating people from each other"

I can see this happening. Earlier, more people worked in groups because they relied on their expertise.

Now, there is no need for this; people can do it alone. Even though this makes the work done, it comes at the cost of isolation.

I am sure for some people this would look like a win.

littlecranky673• 6 months ago

I can see this happening. Earlier, more people worked in groups because they relied on their expertise.

It only isolates you, if you let it isolate you. The pandemic shifted my life, as I have been working alone at home ever since. I am single no kids, and after the pandemic ended I continue to stay "isolated". I knew about that dangers and took active measures - some of which were only possible because I was no longer required to go to an office. I moved to another country, to a location with a lot of international expats that work online, too. I built an active social circle, attending meetups, sport groups, bar nights etc.

I am now more social and happier than ever, because my daily social interactions are not based on my work or profession, and I get to chose with whom I spend my time and meet for lunches. Before, the chores around hour long commutes, grooming, packing my bag, meal-prep, dressing properly etc. just to sit in the office all day - all are gone from my schedule. I have more free time to socialize and maintain friendships, pay less rent, and in general - due to lower cost of living - life quality has improved significantly.

Without work-from-home this would not be possible. You could argue WFH results in isolation and depression, but for me it was liberating. It is, of course, each individuals own responsibility (and requires acitve work, sometimes hard work, too) that will influence the outcome.

wiseowise3• 6 months ago

Which country is that? If it’s not a secret.

fabian4• 6 months ago

AI can change how we work and think, but institutions didn't become fragile overnight because of it. Many of the pressures on universities, media, and governance predate AI by years or decades.

Using AI wisely can augment human capability without eroding institutional roles — the real question is how accountability, transparency, and critical thinking evolve alongside the technology.

wat100002• 6 months ago

When has humanity ever used technology wisely?

ertucetin• 6 months ago

Recently wrote a blog about this: https://ertu.dev/posts/ai-is-killing-our-online-interaction/

Sol-• 6 months ago

Do they assume that the current state of our institutions is normatively correct? AI progress will come and have manifold benefits, therefore we shouldn't really restrict it too much.

If the institutions cannot handle that, they will have to change or be destroyed. Take university, for instance. Perhaps they will go away - but is this a great loss? Learning (in case it will remain relevant) can be more efficiently achieved with personal AI assistants for each student.

techblueberry3• 6 months ago

I think one of the paradoxes of modern life, is I assert that one of the things we're all nostalgic for are institutions. For sure we all believe in different institutions, but watching the decline of institutions, we all seem to be dancing on our own graves.

fullshark3• 6 months ago

Sure I'm nostalgic for my own childish naivety, aren't we all?

techblueberry3• 6 months ago

Your childish naivety values universities, the rule of law, a free press and the military? We had very different childhoods; and more importantly, clearly different definitions on what maturity is.

reactordev• 6 months ago

I’m going to play devils advocate and cough recite a common argument from the pro gun Americans.

“It’s not guns that kill people, it’s people that kill people”.

It’s not “AI bad”, it’s about the people who train and deploy AI.

My agents always look for research material first - won’t make stuff up. I’d rather it say “I can’t determine” than make stuff up.

AI companies don’t care about institutions or civil law. They scraped the internet, copyright be damned. They indexed art and music and pay no royalties. If anything, the failure of protecting ourselves from ourselves is our fault.

baggachipz• 6 months ago

And the vehicle to protect ourselves is called "government". Looking around... yeah.

wrqvrwvq• 6 months ago

The common argument seems to hold up in both cases.

goatlover2• 6 months ago

Yeah but it's people with guns that kill people, therefore a lot of countries regulate & restrict gun ownership to reduce gun violence. Same can apply with AI abuses.

alphazard• 6 months ago

It's not AI. Human institutions rely on humans acting in good faith. Almost every institution is held together by some kind of priesthood, where everyone assumes the priests know what they are doing, and the priests create a kind of seriousness around the topic to signal legitimacy, and enforce norms on the other priests. This is true of Government, Law, Science, Finance, Medicine, etc.

But most of these institutions predate the existence of game theory, and it didn't occur to anyone how much they could be manipulated since they were not rigorously designed to be resistant to manipulation. Slowly, people stopped treating them like a child's tower of blocks that they didn't want to knock over. They started treating them like a load bearing structure, and they are crumbling.

Just as an example, the recent ICE deportation campaign is a direct reaction to a political party Sybil[0] attacking the US democracy. No one who worked on the constitution was thinking about that as a possibility, but most software engineers in 2026 have at least heard the term.

[0] https://en.wikipedia.org/wiki/Sybil_attack

chrisjj11• 6 months ago

Where is Sybil's large number of pseudonymous identities in this case?

sigotirandolas• 6 months ago

N~10^(6.5) aliens.

noosphr• 6 months ago

Why isn't there a major lack of institutional trust of dentists? Between 1990 to today fillings have gone from being torture to something that takes 30 minutes while I listen to a podcast. I've not met anyone who distrusts big dental. But fluoridated water is still a hot topic.

The best that the experts the paper talks about can do today is say that if we follow their advice our lives will get worse slower. Not better. Just as bad as if we don't listen to them, but more slowly.

In the post war period people trusted institutions because life was getting better. Anyone could think back to 1920 and remember how they didn't have running water and how much a bucket weighed when walking up hill.

If big institutions want trust they should make peoples lives better again instead of working for special interests, be they ideological or monetary.

jjice• 6 months ago

Why isn't there a major lack of institutional trust of dentists?

FWIW, I know a lot of people who refuse to go to the dentist unless it's an issue because they're one of the medical professions that seem to do the most upselling.

I go every six months for a cleaning and trust my dentist, but I can definitely see how these huge chain dentists become untrustworthy.

NoMoreNicksLeft• 6 months ago

Why isn't there a major lack of institutional trust of dentists? Between 1990 to today fillings have gone from being torture to something that takes 30 minutes

This one is personally hilarious to me. My dentist said there were "soft spots", that like a fool I let him drill. On the sides of my teeth. Those fillings lasted about 6 weeks before they fell out. He refilled them once, telling me to "chew more softly". Basically, he was setting me up to get caps... but he hadn't checked that my insurance basically covered 0% of such.

My own trust in dentists is nil at this point, though I desperately need dental work.

Dentists make their money by rushing as many patients through in a business day as they can. Boats to pay for, yadda yadda. There might be dentists out there that take their time, who pay attention to the patients needs, and are reluctant to perform irreversible and potentially damaging work... but those dentists are for rich people and I am not rich. Trusting dentists (in general) is one of the most foolish things a person can do.

mellosouls• 6 months ago

Note the author here is presumably not so concerned about the decline of the institutions given his flag-waving for censorship in previous years, eg:

"Banning Trump from Twitter and Facebook isn’t nearly enough"

https://www.latimes.com/opinion/story/2021-01-15/facebook-tw...

Even if you dislike Trump, the campaign to suppress conservative voices of the 2010s (now largely reversed) that he argues for there was a significant contribution to the decline in authority and respect that academia has had in the eyes of the general populace.

To be clear, the same must also apply to any suppression of liberal voices - its unacceptable in a culture that claims free speech.

But I am sceptical that this particular writer has a moral high ground from which to opine.

loudmax• 6 months ago

AI might be accelerating the trend, but there's been a populist revolt against institutions for over a decade. It's been happening long before ChatGPT, and this isn't just in Europe and the US. The erosion of trust in governments and institutions has been documented globally.

The obvious culprits being smartphones and social networking, though it's really hard to prove causality.

Flavius• 6 months ago

The obvious culprits being smartphones and social networking, though it's really hard to prove causality.

Totally get hating on social media, but social media didn’t make politicians corrupt or billionaires hoard wealth while everyone else got crumbs. It just made it impossible to keep hiding it. Corruption, captured institutions, and elite greed have been torching public trust for years. Social media just handed everyone a front-row seat (and a megaphone).

srijith259• 6 months ago

I understand that everyone is disillusioned with current institutions. But I don't understand the prevailing sentiment here that it's therefore okay for them to fail. For one, there will never be perfect institutions. One would think we would create technology to complement and improve them. Instead, recent technological trends seem to have done the opposite.

At the very least, this should make us reconsider what we are building and the incentives behind it.

book_mike• 6 months ago

My word, it doesn't have to be that way.

mistivia• 6 months ago

We have seen similar situations countless times before. Just as the Internet allowed people to bypass publishers to release text, and YouTube allowed creators to bypass TV stations and cinemas to release video, AI now allows people to bypass lawyers to read legal texts, which are often deliberately written to be indecipherable to an average person. AI will not destroy institutions, but it will pose challenges and lead to restructuring.

code512• 6 months ago

I know it's a draft but why on earth people cannot use page formats the same (more or less)?

Material (full page) material material, sources at the end. Simple. Readable.

Material (half page), sources (half page). Material/source. Material/source. Looks quite unreadable to the eye.

dzink• 6 months ago

Think back to Maya history when the rulers kept astronomy knowledge secret to pretend they were Gods and had control over celestial objects. If expensive education and publishing access provides power to someone and free education and publishing becomes a thread to their authority, that’s not a good testimony on how they used their education advantage while they had it.

AI may be destroying truth by creating collective schizophrenia and backing different people’s delusions, or by being trained to create rage-bait for clicks, or by introducing vulnerabilities on critical software and hardware infrastructure. But if institutions feel threatened, their best bet is to become higher levels of abstraction, or to dig deeper into where they are truly deeply needed - providing transparency and research into all angles and weaknesses and abuses of AI models. Then surfacing how to make education more reliably scalable if AI is used.

avsteele• 6 months ago

Obviously ~nobody has read this yet... But I did have a question based on the opening:

"If you wanted to create a tool that would enable the destruction of institutions that prop up democratic life, you could not do better than artificial intelligence. Authoritarian leaders and technology oligarchs are deploing [sic] AI systems to hollow out public institutions with an astonishing alacrity"

So in the first two sentences we have hyperbole and typos? Hardly seems like high-quality academic output. It reads more like a blog post.

embedding-shape2• 6 months ago

Obviously ~nobody has read this yet...

It was uploaded 8 Dec 2025, surely someone have gotten through it by now.

rpdillon4• 6 months ago

I read through it a couple of days ago.

Your read is correct; it's poorly written, poorly argued, and poorly cited. It's basically a draft of an op-ed with a click bait title.

shevy-java• 6 months ago

The title is a bit odd.

For instance:

"The affordances of AI systems have the effect of eroding expertise"

So, some expertise will be gone, that is true. At the same time I am not sure this is solely AIs fault. If a lawyer wants 500€ per half hour of advice, whereas some AI tool is almost zero-cost, even if the advice may only be up to 80% of the quality of a good lawyer, then there is no contest here. AI wins, even if it may arguably be worse.

If it were up to me, AI would be gone, but to insinuate that it is solely AI's fault that "institutions" are gone, makes no real sense. It depends a lot on context and the people involved; as well as opportunity cost of services. The above was an example of lawyers but you can find this for many other professions too. If 3D printing plastic parts does not cost much, would anyone want to overpay a shop that has these plastic parts but it may take you a long time to search for, or you may pay more, compared to just 3D print it? Some technology simply changes society. I don't like AI but AI definitely does change society, and not all ways are necessarily bad. Which institution has been destroyed by AI? Has that institution been healthy prior to AI?

macleginn2• 6 months ago

I think part of the negative attitude towards the effects of AI stems from the fact that it demolishes a lot of structure. The traditional institutes maintain well-structured, low-entropy societies in terms of knowledge: one goes to a lawyer for legal advice or to a doctor for medical advice, one goes/send one's children to a university for higher education, etc. One knows what to do and whom to ask. With the advent of internet, this started to change, and now the old system is almost useless: as you note, it may be more efficient to go to AI for legal advice, and AI is definitely more knowledgeable about most things than most university teachers, if used correctly. In the limit, the society as it existed before is not simply transformed but is completely gone: everybody is a fully autonomous agent with a $AI_PROVIDER subscription. Ditto for professional groups and other types of association that were needed to organise and disseminate knowledge (what is a lawyer these days? a person with a $LEGAL_AI_PROVIDER subscription, if this is even a thing? what is a SWE?). Now we live in a maximum-entropy situation. How do values evolve and disseminate in this scenario? Everybody has an AI-supported opinion about what is right. How do we agree? How do we decided on the next steps? AI doesn't give us a structure for that.

empath75• 6 months ago

AI is definitely more knowledgeable about most things than most university teachers

I think this is under-appreciated so much. Yes, every university professor is going to know more about quite a lot of things than ChatGPT does, especially in their specialty, but there is no university professor on earth who knows as much about as many things as ChatGPT, nor do they have the patience or time to spend explaining what they know to people at scale, in an interactive way.

I was randomly watching a video about calculus on youtube this morning and didn't understand something (Feynman's integration trick) and then spent 90 minutes talking to ChatGPT getting some clarity on the topic, and finding related work and more reading to do about it, along with help working through more examples. I don't go to college. I don't have a college math teacher on call. Wikipedia is useless for learning anything in math that you don't already know. ChatGPT has endless patience to drill down on individual topics and explaining things at different levels of expertise.

This is just a capability for individual learning that _didn't exist before ai_ and we have barely begun to unlock it for people.

mrwh• 6 months ago

If a lawyer wants 500€ per half hour of advice, whereas some AI tool is almost zero-cost, even if the advice may only be up to 80% of the quality of a good lawyer, then there is no contest here. AI wins, even if it may arguably be worse

Interesting example, because when I look at it I think of course I'm going to pay for the advice I can trust, when it really matters that I get advice I can trust. 20% confidently wrong legal advice is worse than no advice at all. Where it gets difficult is when that lawyer is offloading their work to an AI...

chrisjj11• 6 months ago

Indeed the biggest threat to the legal profession is not chatbots used by non-lawyers. It is chatbots used by lawyers, undermining performance of and confidence in the entire profession.

chrisjj11• 6 months ago

even if the advice may only be up to 80% of the quality of a good lawyer, then there is no contest here. AI wins, even if it may arguably be worse.

The overlooks the effect on quality of the penalty for failure. The lawyer giving bad advice can get the sued. The "AI" is totaaly immune.

macleginn2• 6 months ago

The authors are quick to assume "the inevitable atrophy of human skills and knowledge". But skills and knowledge have not been propped up by some low-fi institutional magic: they stem from the necessity of achieving practical goals, as well as general human curiosity and competitiveness. Sure, there will be a period of slop sloshing around everywhere, but the main drives for excellence (or at least passable performance) are not going anywhere.

petcat• 6 months ago

The affordances of AI systems have the effect of eroding expertise

I have actually seen this be a tremendously good thing. Historically, "expertise" and state of the art was reserved solely for those people with higher education and extensive industry experience. Now anyone can write a python script to do a task that maybe they would have had to pay an "expert" to do in the past. Not everyone can learn python or be a computer scientist engineer. Some people are meant to go to beauty school. But I feel like everything has become so much more accessible to those people that previously had no access.

I liken it to the search engine revolution, or even free open source software. The software developed as open source over the last decades are not toys. They are state of the art. And you can read the code and learn from them even if you would never have had the opportunity for schooling or industry to write and use such software yourself.

chrisjj11• 6 months ago

Historically, "expertise" and state of the art was reserved solely for those people with higher education and extensive industry experience ... I feel like everything has become so much more accessible to those people that previously had no access.

Might you ever ride in a car, need brain surgery, or live within the blast radius of a nuclear power station?

mikemarsh• 6 months ago

I wonder if the concern about "civic institutions" as some unique and special thing within society is a generational thing; as a millennial I've almost always viewed "universities, and a free press" ("rule of law" is much more nebulous) as simply "institutions", or rather "the establishment", the key distinction being "the establishment" also includes corporations, banks, big capital, etc.

The "institution" of the AI industry is actually a perfect example of this; the so-called "free press" uncritically repeats its hype at every turn, corporations (unsurprisingly) impose AI usage mandates, and even schools and universities ("civic institutions") are getting in on implicitly or explicitly encouraging its use.

Of course this is a simplification, but it certainly makes much more sense to view AI as another way "the establishment" is degrading "society" in general, rather than in terms of some imagined conflict between "civic institutions" and "the private sector", as if there was ever any real distinction between those two.

funkyfiddler69• 6 months ago

Easy to fix, but it must be done by a front of academics, hackers, engineers and lawyers, which makes it next to impossible because even those with enough time, won't do it. It's a bunch of fallacies, and a bunch of inverted fallacies at play, tightly entangled with a cool Cheshire Cat kind of attitude.

We have the bystander effect, pluralistic ignorance, diffusion of responsibility and everybody is so busy not suing. Why not do it just for the sake of it and to make the whole "game" stronger, harder, better, smarter? The easy path killed millions of species, ideas, intelligent people, solutions, work, things to do.

Then there's the inverted spotlight effect, people believe they matter less than they actually do. The main character theme maximized, it's sad. All the young kids and potential stars abide by the mechanisms of learned irrelevance. Role models? Who? Role roadmaps, maybe, and they are not helpless and just make money and stick to their thing.

An inverted egocentric bias, systems justification theory, credentialism, the authority bias: "that's lawyers in parliament, senate and where ever, damn it! They are smart!" The wealth of others disempowers intelligent people. Bam, corporate paternalism and discouragement of civic engagement.

The right people just need to sue who needs to be sued. And they have to do it big and loud, otherwise this whole show turns into your average path towards a predictable dystopia.

The insane number of species killed should give everybody an inkling about how many ideas, ways of doing things, personalities and so on died, often enough not for evolutionary reasons, but because people ignored the wrong things.

And to those who think that "this is still evolution": it's not, sabotage is not evolution. And it's not securing anyones long term survival. Nobody cares about that of course. We have one lifetime and get to watch half of the life of our offspring, if we choose to, that is, and if we are lucky enough not to get poisoned, spiked, sick or smashed in an accident.

But if you think about the edge of what is possible, and you maximize that image, and you realize how many awesome brains got caught up in ripples of ignorance and a sub-average life of whores, money, power and shitty miniature teraforming, you quickly realise that some kind of immortality was actually on the horizon.

Our ancestors have build an impeccably working order that we simply stopped to maintain because the old guard refused to sue those who just had to be sued so that laws could evolve; and the young adapted. Of course there was and is progress but, a LOT of progress but if you apply readical honesty, you can't unsee and unknow all these big and obvious leaking holes. It's the same on any scale.

Anarchists, lefties and whatnot don't matter in this fight because the bulk of the people trusts competence first, which should be our top, but isn't, and only then do they choose what is marketed, which currently is "Trump"... And if the top behaves in certain ways, people will follow. And all the narratives on TV and the radio come with more than enough subtext. In every town on the planet and every block, corruption, punched drugs, spiking, abuse of power by teachers, trainers, companies, institutions, malfeasance in office, breaches of privacy, you name it, it's on every scale.

If you don't take proper care of that, meaning there must be an ongoing fight and law enforcement must be on the right side, before you let AI amplify and augment it all, then institutions will have a really bad time coming across as credible while corporations will continue to serve the peoples needs and desires ... ALL of their needs and their desires, even those they ought to keep in check: bam, your sub-average path to a predictable, sad dystopia, thank science there will be drugs.

diggyhole• 6 months ago

Oh you mean the same institutions that imprisoned Aaron Swartz for trying to democratize information? plays smallest violin

ChrisArchitect• 6 months ago

[dupe] https://news.ycombinator.com/item?id=46644779

GardenLetter27• 6 months ago

"Eroding expertise" - just sounds like lawyers and notaries, etc. worried that the gravy train is coming to an end.

dooglius2• 6 months ago

It's not clear from the page but this is the intro to a whole paper at SSRN https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5870623

rlewkov• 6 months ago

"Civic institutions—the rule of law, universities, and a free press—are the backbone of democratic life." Why are universities part of this set backbone items?

johngalt7• 6 months ago

Full paper is here https://download.ssrn.com/2026/1/21/5870623.pdf?response-con...

Sam6late• 6 months ago

I think cutting off money is like an emergency wound that needs a bandage right now to keep the school alive. AI is more like a difficult puzzle—universities can solve it eventually, but only if they are stable and have the budget. There are some lame attempts at taming the AI shrew:

In reality a far more serious threat is the loss of academic freedom. This guy must deal with that issue, and onslaught on academic freedom and that is the real question because in 2025, billions of dollars in federal research grants were frozen for institutions, including Harvard, Columbia, Cornell, Northwestern, and UPenn. The US federal government remains the single largest funder of university research, accounting for approximately 55% of all higher education R&D expenditures (this is a capitalist country btw).

erelong• 6 months ago

I think a lot of people are rooting for AI to destroy corrupt institutions

SunshineTheCat• 6 months ago

universities, and a free press—are the backbone of democratic life...

The self-importance and arrogance of some people in universities never ceases to amaze me.

I'm not saying they don't have value; doctors, nurses, lawyers, wouldn't exist without a university.

But calling it the "backbone of democratic life" is about as pretentious as it comes.

The reality is that someone bagging groceries with no degree offers more value to "democratic life" in a week than some college professors do in their entire career.

zbentley• 6 months ago

Everyone interested (critically or not) in this paper should also read “Recoding America” by Pahlka. While written before the AI boom, it gives an extremely thorough treatment to institutional behaviors re: technology and effectiveness, informed by and informing Pahlka’s work with the United States Digital Service as a means of addressing these issues.

thestructuralme• 6 months ago

Feels less like ‘AI destroys institutions’ and more like it removes the friction that used to force competence: drafts become publishable, citations become optional, accountability gets diffused. Institutions fail when error becomes cheap and responsibility becomes unclear. The fix isn’t banning tools, it’s redesigning workflows around verification, audit trails, and explicit ownership.

How AI destroys institutions

Related Stories