HN user

Legend2440

2,711 karma
Posts0
Comments808
View on HN
No posts found.

This is a very well studied problem. Well-known mathematicians have spent a lot of effort on it - Yitang Zhang wrote his entire PhD thesis on it back in 1991.

It is deeply unlikely that a random guy at Anthropic just happened to solve it so they could pass it off as the LLM's work.

Just this week an LLM found a counterexample to math problem that's been widely studied for over a century: https://en.wikipedia.org/wiki/Jacobian_conjecture

The conjecture was first stated for two variables by Ludwig Kraus in 1884[1] and then stated in full generality in 1939 by Ott-Heinrich Keller.[2] It was subsequently widely publicized by Shreeram Abhyankar,[3] as an example of a difficult question in algebraic geometry that can be understood using little beyond a knowledge of calculus.

The Jacobian conjecture was notorious for the large number of published and unpublished proofs that turned out to contain subtle errors.[4][5]

On July 19, 2026, Anthropic employee and mathematician Levent Alpöge presented an explicit counterexample in three-dimensional space, discovered by Anthropic's large language model Claude Fable 5, which disproves the conjecture for n > 2

If that won't convince you that LLMs do more than parrot existing ideas, you've got your head in the sand.

Oh, that's bs. You could say that about the tractor, or the mechanical loom, or any of the other incredible labor-saving inventions over the last two hundred years.

We want things to do our work for us so we can do other things. That's not bad, and it's certainly not the same as literally enslaving another human.

I think this is an error in the leaderboard. Looking at the test logs, they had reasoning effort set to 'high'. So it should be in the CoT category instead of the base LLM category.

https://huggingface.co/datasets/arcprize/arc_agi_v1_public_e...

  "kwargs": {
     "max_tokens": 100000,
     "stream": true,
     "reasoning_effort": "high",
     "rate_limit": {
        "rate": 2,
        "period": 60
     }
  }

The other paper ran Deepseek v3.2 without reasoning as a baseline and got 15.5%, which is much more in line with other base LLMs like GPT-5.2.

but you're not going to make a tiny model perform like one ten times larger just by that.

Small reasoning models do indeed outperform base models that are 10x larger, at these logic/reasoning tasks that require serial computation.

They do not outperform at tasks that rely more on world knowledge or memorization.

In most cases the base model cannot complete logic tasks at all, or only for very small instances; it's reasoning or nothing.

but that doesn't mean they learn any kind of algorithm

They do indeed learn algorithms and can step through them with CoT. This is what allows reasoning models to, e.g. reliably multiply large numbers by applying the grade-school multiplication algorithm.

I don't agree with your definition.

The point of reasoning models is that some tasks fundamentally require a certain number of serial steps. Base models are limited to learning parallel algorithms because of their parallel training, and so struggle on inherently-serial tasks like solving logic puzzles.

The advancement from reasoning is that it allows LLMs to learn a broader class of algorithms.

It took a while, but the original ARC ultimately fell to exactly the approach it was supposed to be protected from, i.e. big data memorisation

No it didn't. People tried big data memorization, and it didn't work. Base LLMs (even with millions of synthetic examples) never solved ARC-AGI-1.

It took a real algorithmic advancement - reasoning models - to solve it.

That's not what your linked article says.

37% of survey respondants say they would need to use a credit card to cover a $400 expense. They wouldn't be destitute, they just don't immediately have the cash.

It also cites another study that put the number much lower, at 8%.

The industrialization of rich nations did not make Africa poor.

Once upon a time, everyone was poor. Then, some countries industrialized and others didn't. The ones that didn't are still poor today.

Some countries like China have recently pulled themselves out of poverty through industrialization. Someday Africa will do the same.

I can't actually think of a single piece of tech made in the past ten years that has improved my life

This is going to be controversial, but I feel that ChatGPT has improved my life.

Also e-bikes, 3D printers, and wireless earbuds really took off in the last ten years. Some of these were invented more than 10 years ago but saw significant improvements that brought them into the mainstream.

We reading the same media here? All the major tech news publications like the Verge or ArsTechnica take a highly skeptical tone towards AI.

Nearly every major newspaper company is actively suing AI companies over copyright infringement. They have been quite outspoken that they see Google's AI overviews as an existential threat to their business.

That's cynical nonsense and I don't believe a word of it. Prohibition was repealed by popular vote, not by bought-out politicians.

And we're not 'oppressing' fent addicts by arresting them when they pass out on the sidewalk in front of my apartment. They are causing a problem for the rest of society that we now have to deal with. That's why we do the war on drugs.

A harness is just a piece of software that exposes APIs for reading files, connecting to the internet, etc.

It parses the LLM output for tool calls, executes the command, and puts the output back into the LLM input. That's all there is to it.