HN user

dlkf

1,223 karma
Posts15
Comments348
View on HN

I mean, the matrices obviously change during training. I take it your point is that LLMs are trained once and then frozen, whereas humans continuously learn and adapt to their environment. I agree that this is a critical distinction. But it has nothing to do with “meaningful internal structure.”

Previous generations of neural nets were kind of useless. Spotify ended up replacing their machine learning recommender with a simple system that would just recommend tracks that power listeners had already discovered.

“Previous generations of cars were useless because one guy rode a bike to work.” Pre-transformer neural nets were obviously useful. CNNs and RNNs were SOTA in most vision and audio processing tasks.

Current AI systems have no internal structure that relates meaningfully to their functionality

In what sense is the relationship between neurons and human function more “meaningful” than the relationship between matrices and LLM function?

You’re correct that LLMs are probably a dead end with respect to AGI, but this is completely the wrong reason.

Would new developments (or old developments that had gone underappreciated) in an adjacent stem field count as ”added cultural context” ?

Why YC went to DC 2 years ago

It means that google doesn't have to aquire-hire your team, they can just poach all of them wholesale.

Imagine a skilled worker taking a new job that pays better. What a nightmare scenario.

Literally any definition of something infinite can always be reduced to a procedure that recursively transforms or observes some prior state.

You can’t generate R this way. This is a consequence of Cantor’s proof.

Your critique of the use of ”bigger” in your strawman applies equally to your own use of ”longer” - neither loop will ever terminate. So in what sense is either one longer?

The diagonal proof is arguing that there is no bijection from N to {0, 1}∞ , despite the fact that both are infinite. The sense in which the latter is ”bigger” is that there are always elements left over that are covered by N.

I’m not sure that you can. What I’ve read is that in a lot of fields, the community is small enough that you have a reasonable idea whose work you are reviewing even if the author’s name is redacted.

I’m not accusing Whitehead of the fallacy, I’m talking about the parent post.

Parent is suggesting that if we don’t take Deleuze seriously, we should also not take Whitehead seriously. (Despite Whitehead being a fav of the analytic crowd.)

But the Deleuze comparison, to the extent that it makes any sense, only applies to the later Whitehead. We don’t have to reject the Pricipia. The obvious position is that Deleuze is not-even-wrong, process philosophy is not-even-wrong, and the principia is merely wrong (which is amazing in philosophy.)

Hume wrote morality is better felt than reasoned. There is a large tradition in virtue ethics following Hume (eg Bernard Williams) who defend our moral intuitions, our prioritization of family, etc.