HN user

grandinquistor

30 karma
Posts2
Comments13
View on HN
Claude Opus 4.7 3 months ago

looking at the system card for opus 4.7 the MCRC benchmark used for long context tasks dropped significantly from 78% to 32%

I wonder what caused such a large regression in this benchmark

Claude Opus 4.7 3 months ago

Huge regression for long contest tasks interestingly.

Mrcr benchmark went from 78% to 32%

Claude Opus 4.7 3 months ago

Probably deprioritizing other areas to focus on swe capabilities since I reckon most of their revenue is from enterprise coding usage.

Claude Opus 4.7 3 months ago

Quite a big improvement in coding benchmarks, doesn’t seem like progress is plateauing as some people predicted.

Claude Opus 4.7 3 months ago

Quite a big improvement in coding benchmarks, doesn’t seem like progress is plateauing as some people predicted.

I’m at Big tech and our org has our sights on automating product manager work. Idea generation grounded with business metrics and context that you can feed to an LLM is a simpler problem to solve than trying to automate end to end engineering workflows.

Claude Sonnet 4.5 10 months ago

I’ve been using AI coding tools (Cursor, Claude Code) for React/React Native side projects. I have experience with these frameworks so I could guide the AI with individual tasks and catch mistakes, and overall it worked pretty well.

Recently I tried building a native iOS app with zero Swift experience, giving the AI just a markdown spec. This was basically vibe coding, I didn’t understand much beyond general software principles. It quickly broke down: hallucinated method signatures, got stuck on implementing extensions, and couldn’t recover. I would run the app on my device and give it feedback and logs. After hours wasted, I spent some time reading the docs and fixed the issues myself in 30 minutes.

My takeaway: AI will accelerate developers but won’t replace them. Still, acceleration means fewer engineers will be needed to ship the same amount of work.

I think music used for commercials, movie trailers etc will move to be AI generated (taking a revenue stream from artists into soul less corporations).

But for cases where music is the primary product, I don’t for see AI generated music overtaking anything