jordan_bonecut

Disagree, there are practical trivial subsets of the halting problem to which I imagine many short-running scripts would conform.

Yes, but it could learn to associate tokens with word counts as it could with meanings.

Even still, if you ask it for token count it would still fail. My point is that it can’t count, the circuitry required to do so seems absent in these models

Yes, but so is telling if a photo contains a dog or understanding sentiment in a paragraph of text. Complexity isn't quite the issue, I think it is that there is a distinction between the type of reasoning which these models have learnt and that which is necessary for concrete mathematical reasoning.

This is an interesting article and goes along with how I understand how such models interpret input data. I'm not sure I would characterize the results as blurry vision, but maybe an inability to process what they see in a concrete manner.

All the LLMs and multi-modal models I've seen lack concrete reasoning. For instance, ask ChatGPT to perform 2 tasks, to summarize a chunk of text and to count how many words are in this chunk. ChatGPT will do a very good job summarizing the text and an awful job at counting the words. ChatGPT and all the transformer based models I've seen fail at similar concrete/mathematical reasoning tasks. This is the core problem of creating AGI and it generally seems like no one has made any progress towards synthesizing something with both a high and low level of intelligence.

My (unproven and probably incorrect) theory is that under the hood these networks lack information processing loops which make recursive tasks, like solving a math problem, very difficult.

The stack does not grow because HolyC does not utilize virtual memory.

How does this work?

There’s a lot of weird stuff between Vegas and CA! The weirdest one is an abandoned Nuclear bunker which I believe was built by AT&T 30ish years ago off Razor Road. Eddie World is up there too, something tells me not to trust a giant ice cream cone in the middle of nowhere :)

It's one thing to advertise something as a modernized version and another to advertise it as the original work of the authors. Isn't it worth preserving how things were in the past? If not how will we understand where we came from? How will we know how to learn from mistakes if they're just erased?