HNGlance

Top Best New Show

Open model StepFun-3.5 is #1 on MathArena, an uncheatable math benchmark

https://twitter.com/CyouSakura/status/2021511358626554322

by diyer22 • 5 months ago

3 2 5 months ago

TW

Related Stories

Loading related stories...

Comments

2

falcor84• 5 months ago

How is "uncheatable"? If you know the exact olympiad questions it's being assessed on, what's stopping you from massaging it until it gets more of them right than the previous number 1?

diyer22• 5 months ago

MathArena uses newly released competition sets and evaluates models close to the event. They also mark models released after the competition date as potential contamination.

On Feb 6, the just-concluded AIME 2026 I, Step 3.5 Flash take first place. Step 3.5 Flash was released on Feb 1, making cheating impossible.

Source preview

twitter.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms