Ask HN: Why does LLM struggle in playing 24 puzzle

https://news.ycombinator.com/item?id=39646333
by yegle • 2 years ago
2 2 2 years ago

I have yet to find an LLM that solves the 24 puzzle with these numbers (6 9 9 10) correctly.

Many seemingly capable LLM will produce incorrect intermediate or final results, e.g. claiming 9 × 9 ÷ (10 - 6) = 24.

Did I miss anything in my prompt? Or if there's a reason LLMs are bad at these questions?

Related Stories

Loading related stories...

Source preview

news.ycombinator.com