HPMOR

Fable is insanely annoying. It treats me like an incompetent, suggesting when something is in my expertise that I'm actually wrong. And then it will simply refuse to engage or do what's asked. Anything related to present day American Politics is strictly off limits. How is this truth seeking, or rational? Model misalignment increases when post-training is done on non verifiably domains. Scary times indeed.

Yeah, this is correct. There are so many large multi-trillion dollar companies coming to IPO, which if your are passive index holder and you are trying to track the market it is correct for these companies to be included. And besides SPY has chosen not to fast track where QQQ has. It is a free market, and folks are free to NOT buy QQQ. So I'm not sure why this is a point of debate.

He created Django, what do you mean he's not an engineer? Also 'low-effort??' his posts are extremely in-depth, clearly very thought through with a significant amount of time and energy. Additionally he does perform multifaceted checks across LLMs in many of his other blog posts.

It is more than just books published pre-2022, but I've noticed that it is necessary to buy books __printed__ before 2022. Recently I've noticed aggressive misspellings and misquotations in old books printed in '25/'26. I believe these errors are being introduced because the publisher is using an LLM or some similar tool to correct any prior errors but is introducing more hallucinations. Or perhaps the cause is people caring less than they used to?

Wow - Google paid a couple billion dollars to bring Noam back. Really impressive by OAI if this reporting is accurate!

Yeah I know some of my team members have invested a lot of time in this. Could definitely be worth chatting with them on what improvements could be made here. We're starting to deprioritize our consumer facing agent harness, in favor of more infrastructure level improvements we are making.

Interesting. We definitely have long-running agents where certain preferences are key. However, some of the preferences are likely going to be shared universally across our customers. Is there some way of triaging this feedback into permanent improvements in agent performance?

I'm curious who the ideal customer of this should be. If we're a startup with our own harness, are we a good fit? What would qualify us or disqualify us from being a good user?

Holy shit, I cannot believe this is an actual belief people currently hold. We fought a war for this amendment.

This is like saying - 'I don't understand why anybody would ever buy a pizza from a store. All you have to do is get some flour, water, tomato sauce, cheese, mix the flour and water together, whip the dough, add tomato sauce, put cheese on top of it, cook it for 20 minutes, and then serve it.'

So __much__ value is in the fact things are easy. Money is __not__ the most valuable thing in the world.

Sorry, I think you mean abiding*. But laws are not some moral edicts handed down by god. They can and often are wrong or seriously misguided. Laws can and should be broken if and only if the agent at hand has a thorough understanding of why they are violating the law. Breaking a law and antisocial behavior are not necessarily equivalent.

No it was Dan Cane. He’s gone on to found a second decacorn called ModMed. Truly one of my role models.

Holy shit this is horrible. It really shows the true cost of having a disciplined public society. People love to hate on SF, and the homelessness. But I think it’s a society that prioritizes individual freedom which allows for both this outcome and the entrepreneurial environment we see.

One of my mentors created Blackboard. It used to be very very good, but he sold it to private equity, and they immediately fired all of the customer support and developers, 3xd prices overnight leading to the 'blackboard sucks' problem. This gave the opening for Canvas to eventually come on to the scene and dominate.

I think merging them into either this thread, or the System Card makes the most sense to me.

I asked claude to decipher this and it refused. I asked gemini and it was permissible. Very interesting to see ROT-13 banned via Anthropic as a 'prompt injection' risk.

Anecdotes __are__ data. How much weight you ascribe to it as being representative is different. But you cannot disqualify it as 'not data'. It is usually a leading indicator of what could potentially show up in these more robust datasets.

This almost certainly is. I fear that Claude is likely being attacked by foreign (domestic?) adversaries.

Wow - glad they updated fast. Feel like incident reports are notorious for not updating fast. Kind of impressed tbh.

Such a dipshit administration. I hope California secedes from the union to protect our champions.

Google makes over $1bn/day. $68mm is literally an hour's worth of revenue to them - so yes pennies.

No - because the AI will be super human. No human even at $1mm a year would be competitive with a $100k/yr corresponding AI subscription.

See people get confused. They think you can charge __less__ for software because it's automation. The truth is you can charge MORE, because it's high quality and consistent, once the output is good. Software is worth MORE than a corresponding human, not less.

Yeah SF is 10x every other place in earth. People that think things are comparable have never lived here.

Why is this being hidden off of the main HN pages? There are clearly enough points for it to be significantly up weighted. I don’t understand the censorship.

I think this is an open question still and very interesting. Ilya discussed this on the Dwarkesh podcast. But the capabilities of LLMs is clearly exponential and perhaps super exponential. We went from something that could string together incoherent text in 2022 to general models helping people like Terrance Tao and Scott Aaronson write new research papers. LLMs also beat IMO and the ICPC. We have entered the John Henry era for intellectual tasks...

Why is this the case? I don't understand, can somebody explain the logic to me here?

There’s a line in the book I quite liked: “All the interesting people disappear to San Francisco.” Was incredible to me that even back then, SF was known for its homosexual culture. Lord Henry was remarking on where Basil likely had disappeared, so the insinuation was that Basil felt more at home in SF.

So when will they be available for commercial rides? Can't wait to waymo from SF to Berkeley!

https://archive.is/uel4S

Something about the cadence, structure, and staccato nature of the bottom paragraphs also felt very LLMed.