MikhailTal

this is /goal in claude code/codex. also basically a slightly improved ralph loop

is this really that surprising?

Exploitgym prompts are tuned for a model to do everything it can to achieve a cybersec/exploit task. And we know that models are good at finding vulverabiltiies.

Its just random that the sandbox itself was buggy. But all that happened here is that we told a model "do everything you can to achieve your goal of hacking X" And it just hacked Y as a roundabout way of hacking X.

Imo its PR for OpenAI to also start the mythos class mysterious unreleased model hype.

From HF statement: "AI safety won't be solved by any single company working in secret". So now we have TWO companies working in secret

the OP asked why, you more described the how.

What is the benefit of all this?

"Lottery winner says you should not gamble"

Also, the OP just does not understand how the market works anyway. Surely if it was obvious that investing in fresh IPOs is a bad move, all of the big boys (banks, hedge funds etc) would short them to the point of equalising anyway. Maybe not to the absolute efficient point, but still, why do people think they can see such a huge obvious trend, and also assume that other people cannot see it?

This is not a new situation. This was happening also when good vision models like alexa net were coming through, especially for OCR. Companies had choice between cloud or self hosting with GPUs. But turns out, problem is usage patterns.

Your usage will peak during certain timezone work hours(even if you are a huge multinational company most of your engineers/users tend to be from only a few locations), so then you have a bunch of gpus doing nothing the rest of the day. especially with latency sensitive stuff, this is a decades old tradeoff problem, its not unique to llms