rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking

https://arxiv.org/abs/2501.04519

by roboboffin • 2 years ago

39 7 2 years ago

arxiv.org

throwaway81523• 2 years ago

Abstract is impressive. I'm surprised this post hasn't gotten more attention.

roboboffin• 2 years ago

Yeah, that's what I thought.

dantodor• 2 years ago

The repo gives 404?

funcDropShadow• 2 years ago

The abstract says the code will be available.

s-macke• 2 years ago

Notably, no self-reflection training data or prompt was included, suggesting that advanced System 2 reasoning can foster intrinsic self-reflection.

They suggest, that self-reflection is an emergent phenomena of reasoning. Impressive. Can't wait to see the code.

helltone• 2 years ago

Off topic but how is MCTS usually implemented efficiently? It has a branching structure that doesn't seem parallelizable (GPU).

fabmilo• 2 years ago

I was just about to submit this link and redirected me to this page. I am shocked that it received only four comments. If you are working in the LLMs/Agent space ( you are, right?) and you don't understand the significance of this paper, you are set for failure.

rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking

Related Stories