HN user

MukundMohanK

8 karma
Posts12
Comments3
View on HN

Between last April and now, swe-bench scores have gone up from 25%-70%.

Sure, they're being overfitted to the dataset. But with most performing similarly across even the hardest of 3rd party benchmarks, think frontier math back in Nov and now, we're closer than ever to a specialisation shift.

Hard to say at what % but once code reviews get better its likely 2025 is the last year SWE is a sought after job * demand and supply both