Bullshit About Bullshit Machines [pdf]

https://aphyr.com/data/posts/411/the-future-of-everything-is-lies.pdf

by hedayet • 3 months ago

89 46 3 months ago

aphyr.com

thelastgallon• 3 months ago

There were discussions on each of the chapters: https://news.ycombinator.com/from?site=aphyr.com

ramon156• 3 months ago

Something that is still not clear to me is, what is conscious even. It references the Chinese Room experiment:

Suppose that artificial intelligence research has succeeded in programming a computer to behave as if it understands Chinese. The machine accepts Chinese characters as input, carries out each instruction of the program step by step, and then produces Chinese characters as output. The machine does this so perfectly that no one can tell that they are communicating with a machine and not a hidden Chinese speaker.

But what makes a human mind more "understanding"? Who says we're not simulating? Who says our mind even exists, in this space?

We're also a neural network, are we any more clever than a simulated one?

grebc• 3 months ago

But what makes a human mind more "understanding"? Who says we're not simulating? Who says our mind even exists, in this space?

The people running the experiment.

And yes is the answer to what should be a rhetorical question.

throwanem3• 3 months ago

I say.

2ndorderthought• 3 months ago

I see you have been downvoted. I also see how you can reason your way into your points of view. Let me see if I can add some points to consider.

1. Current ai models people use may be called neural networks, but they bare almost no real semblance to biological ones.

2. A complete human brain is not a compilation of all text books and internet chats. It is a nuanced technology shaped by human experiences , lived and biased by the chemistry of the human body. Human thought is not always linguistic. In the same way you do not tell your lungs to breathe every breath you can find a work of art astoundingly beautiful or a landscape to inspire you. Cleverness is one axis out of a billion to meter consciousness.

3. The human mind or consciousness stirs a lot of philosophical debate. Probably best not touched with a 10 ft poll on the Internet with strangers. I would encourage you to think about or read about human experiences, the synchronicities, and coincidences that happen between people. Especially under times of uncertainty, or blissful innovation. AI is seated backwards in the hierarchy of consciousness. That doesn't mean it's not useful but it's like comparing a water purification plant to the planets treatment of water from rain to subsurface flows and atmospheric chemistry.

Peace

mojuba3• 3 months ago

But what makes a human mind more "understanding"?

If you view understanding as knowledge + the ability to apply it, everything falls into its place. The Chinese room can't apply the knowledge that it has, even theoretically.

nh23423fefe3• 3 months ago

That's not true. The Chinese room is no different than an immobile Chinese person.

Leveraging ability gets you nothing.

projektfu3• 3 months ago

I think these questions were addressed by Searle[1]. His argument is not that AI is impossible, it's that the existence of surprisingly human-like behavior doesn't turn a non-cognitive system into a cognitive one. The strong AI hypothesis is that you can make a computational system where, if its output is similar to what a human would produce by cognition, the system must model cognition. The Chinese room is an argument against that hypothesis.

The paper also provides some suggestions as to where cog sci needs to go to make AI possible.

From my viewpoint, if you really think that LLMs can model cognition, then you are also going to have to bring along a model of human cognition to compare it to, and you have to do it "under the hood" as it were. The external behavior is not enough. In my formulation, if a space alien showed up with vastly different biology but appeared to be cognitively conscious, we may or may not want to believe in its cognitive ability, but it's just whattaboutism to use this hypothetical alien to argue for consciousness of the LLM.

1. https://www.cambridge.org/core/services/aop-cambridge-core/c...

wolttam• 3 months ago

Consider cognition as simply the manipulation of information and data into something different and LLMs can do plenty of that.

Animals perform cognition.

We shouldn't confuse consciousness or agency or with cognition.

rickydroll• 3 months ago

Which category do Bumblebees play with balls fit into?

https://www.cnet.com/science/biology/bumblebees-like-playing...

josefritzishere• 3 months ago

The discussion of AI "consciousness" always recedes into a semantic fog. It's not alive. It's not thinking. Anthropormorphizing software does not benefit our understanding, only it's marketing. ECREE (Extraordinary claims require extraordinary evidence) There has been no evidence of consciousness, extraordinary or otherwise. Everything else is rhetorical nonsense.

pron• 3 months ago

We're also a neural network, are we any more clever than a simulated one?

This is tangential, but it is highly unlikely that we are "a neural network". Neural networks are an architecture loosely inspired by some aspects of the brain, but e.g. it's highly unlikely that we learn by backpropagation (neural signals don't travel in that direction). The brain is a network of neurons, but neural networks are something else. Neural networks probably don't work as the brain does.

qsera• 3 months ago

I think we can talk about intelligence without introducing consciousness.

So there are two questions

1. Is LLMs really showing intelligent behavior. 2. Is that real intelligence.

I think even to the first question, the answer is no. Because really intelligent behavior that can solve complex math problems should be also be able to do basic things like counting, without any extra mechanisms. Intelligent behavior would understand low level things, and building understanding of higher level things using them. When an entity shows "understanding of higher level things, without showing an understanding of some of the low level things involved, then it becomes clear that the entity is not intelligent.

So this should be proof enough to identify that LLMs does not in fact show intelligent behavior. It is just some trick. An illusion. So we can reach this conclusions even without consider the implementation and training of LLMs, which We would only have to consider it to answer the second question, which was not required because it failed the first one.

colinhb2• 3 months ago

Tangent - does anyone immediately recognise how this was typeset? I’m guessing it’s some kind of pandoc output?

I read the original chapters online but appreciate this format.

pdhborges• 3 months ago

It's in the file metadata:

- LuaTeX-1.17.0

- LaTeX via pandoc

aphyr• 3 months ago

Yup. The only major changes here are fonts and twocolumn. https://gist.github.com/aphyr/6f0cd6910ccfe2cd7828d1ade2eac5...

colinhb2• 3 months ago

Thanks - appreciate it!

Nukahaha• 3 months ago

"Unavailable Due to the UK Online Safety Act"

Isn't the "free" world a beautiful thing? -_____-'

ogogmad• 3 months ago

Use a VPN or Tor browser?

lambertsimnel• 3 months ago

Or the Internet Archive:

http://web.archive.org/web/20260421123054/https://aphyr.com/...

YeGoblynQueenne3• 3 months ago

Sounds more like a self-imposed penalty by the author. I mean I can read most of the world internet without such a message so I don't know what it even means.

estimator72922• 3 months ago

This is what the UK government wants. Kyle has spent an insane amount of effort to get answers from OFCOM, got none, and as such blocks the UK for self-preservation. The UK wants to fine non-citizens for violating online purity rules, so this is the result.

Blame the UK for this bullshit. The rules say you must geoblock the UK or be fined, and then sometimes you still get fined anyway.

dwroberts• 3 months ago

Can we stop putting this site on the front page if it has geoblocking for certain locations? Or at least require an archive link with it?

tardedmeme• 3 months ago

Would we do the same for sites unavailable in North Korea? If your country is blocking sites, speak to your government about it.

te_chris• 3 months ago

the country isn't blocking his site. his self-importance is. OFCOM doesn't give a shit about this blog.

dfxm12• 3 months ago

Can't you put archive.is/ in front of the url to get your own archive link? Or is that geoblocked too?

estimator72922• 3 months ago

Blame your own government for trying to levy fines on non-citizens anywhere on the entire damn planet without explaining or justifying itself.

Kyle has spent a lot of time and resources trying to talk to OFCOM. They won't give answers, so the only reasonable option is to block the UK.

Which is the entire point of your laws. Blame yourself.

gib444• 3 months ago

Going to Uno Reverse that back to you - the current edition of "think of the children" is from organisations in the US pushing their agenda all over

Get your own house in order (if you're from the US), and ironically, keep your nonsense within your own borders....

deltarholamda• 3 months ago

It also blocks IPs from states with age verification laws. I mean, okay, I respect the principle, but since there's very little I can do about the laws, and since there are exactly zero politicians who are going to fret because they can't visit aphyr dot com, it's a bit pretentious. So I guess I'll just k-line all aphyr dot com links in my filter and move on with my life. Everybody blocking everybody is how we win.

throwanem3• 3 months ago

The sooner, the better. The more quietly, too.

kordlessagain• 3 months ago

Hacker News is not expected to understand this, but since I’ve brought up M3GAN it must be said: LLMs thus far seem incapable of truly serving cunt.

And here we are upvoting this drivel. This individual has clearly never used Claude in unhinged mode.

throwanem3• 3 months ago

If you think that is serving then - oh, what's the use, none of this was ever for you. It even says it isn't!

Bullshit About Bullshit Machines [pdf]

Related Stories