rabbitlord

More like mathematical depression.

nice to know it!!!

With all due respect, this github repo looks really like an AI-generated project.

TBH, if a paper is not written by Latex, I naturally question the research and learning ability of the authors, and I don't want to read it.

H200 is not cheap, and I don't think you can run DeepSeek with full weight without any quantization on even two of them.

Although open weights in theory are good, especially for developers and market competition, it is not as wonderful as you thought.

but that is also discouraging. For example, I just ran for 30 mins, but that only gives me half a cookie. Why the f do I even run?

The world is lost, I don't think it is any better in non-western countries.

So you can imagine how much surveillance has expanded in countries without such discourse.

I am not a fan of Anthropic guys, but this time I stand with it. We all should.

Guys, I get it that Anthropic also scrapes the internet to train the model. But I feel like scraping open web and distilling from a frontier model is different?

Distillation also directly inherits a frontier model’s alignment and behavior, without paying the underlying R&D or safety costs. That may be a different incentive problem than web scraping.

This feels similar (even if not identical) to a pharmaceutical company reverse-engineering a drug developed through years of costly R&D. It surely can lower prices and expand access to more people, but it’s not obvious that this is a long-term win-win situation. I don't know.

This is so nice. Great up!

Perhaps need a little bit performance improvement? I am using Firefox and the loading is pretty slow.

I think they can do in-context learning.

You will find out that Top CS conference is never scientific, if you really go to their GitHub and run their code.

Really cool!!

Bro the game is intense!

Yeah, I think he’s trying to equate it to something like “there are no stupid questions.” That’s a pretty silly analogy, but you get the idea.

I’ve always felt it’s unfair that people attribute the “System 1/System 2” dual-reasoning idea to KT. Their research was mostly behavioral, and many of their classic psychology experiments (Linda problem, law of small numbers, representativeness bias, etc.) never mentioned two systems. The dual-process framework only emerged around the 2000s in cognitive psychology and neuroscience (e.g., Jonathan Evans, Keith Stanovich), which later provided brain-based evidence for it.

When the book came out, KT basically retrofitted their earlier behavioral work into this newer two-system framework. The book made the distinction famous, but that wasn’t really KT’s original contribution. Their biggest impact was bringing psychology into economics, i.e., prospect theory, alternative utility functions, and ultimately the creation of behavioral economics. I think people often don’t give enough credit to what they actually pioneered, and instead celebrate them for concepts they didn’t really originate.

Great suggestion. "Just do it" usually just works.

This is really good and inspiring writing. I love it.