Neo (Autonomous ML engineer) is leading the MLE Bench with 34.2% score

by Vij137 • 11 months ago

2 6 11 months ago

Vij1373• 11 months ago

Excited to share that NEO is the first fully autonomous Machine Learning Engineer. It can reason, plan and iterate on complex data cleaning, feature engineering and model training tasks.

Neo is now the SOTA Machine Learning Engineering agent on OpenAI's MLE-Bench.

For context: Microsoft's RD agent is at 22.4%.

andsoitis2• 11 months ago

That’s not the GitHub for Neo, is it?

When I go to the website I can Join waitlist - https://heyneo.so/

Smells vaporware-y, fwiw

Vij1373• 11 months ago

Wow..Vaporware? how? Did you even check the leaderboard on openAI's official github? If not, first check that before calling it whatever.

Here:https://github.com/openai/mle-bench

They are not just distributing trophies to anybody. It was built over 10 months with a small team and some GPUs.

gauravvij137• 11 months ago

Did you miss reading the official leaderboard score on openai/mle-bench page where it clearly states that Neo has the best score on mlebench?

Neo (Autonomous ML engineer) is leading the MLE Bench with 34.2% score

Related Stories