HN user

shpongled

1,097 karma
Posts0
Comments357
View on HN
No posts found.

As someone who is "into" programming languages (and making toy implementations of them), I think some of the most important macros are along the lines of Rust/Haskells `derive/deriving` for quickly enabling serialization, printing etc. Using a language without such capability quickly becomes frustrating once you move to any kind of "real" task.

Zig Libc 6 months ago

As someone who has been primarily writing Rust for the past 8+ years, I am actually unaware of any political drama surrounding Rust. It's just a programming language.

No, it doesn't. The "I'm an expert at AI detection" crowd likes to cite things like "It's not X, it's Y" and other expression patterns without stopping to think that perhaps LLMs regurgitate those patterns because they are frequently used in written speech.

I assign a <5% probability that GP comment was AI written. It's easy to tell, because AI writing has no soul.

If you consider correctly citing a source that is explicitly provided in the context via tool use, then sure.

They absolutely cannot correctly cite sources otherwise.

It's not totally novel, but it's very cool to see the continued simplification of protein folding models - AF2 -> AF3 was a reduction in model architecture complexity, and this is a another step in the direction of the bitter lesson.

Protein folding is in no way "solved". AlphaFold dramatically improved the state-of-the-art, and works very well for monomeric protein chains with structurally resolved nearest neighbors. It abjectly fails on the most interesting proteins - just go check out any of the industry's hottest undrugged targets (e.g. transcription factors)

When I mean "use" them, I mean make heavy use of them, e.g. structs or functions annotated with multiple lifetimes, data flows designed to borrow data, e.g. You can often get by just with `clone` and lifetime elision, and if you don't need to eke out that last bit of performance, it's fine.

As someone who loves SML/OCaml and has written primarily Rust over the past ~10 years, I totally agree - I use it as a modern and ergonomic ML with best-in-class tooling, libraries, and performance. Lifetimes are cool, and I use them when needed, but they aren't the reason I use Rust at all. I would use Rust with a GC instead of lifetimes too.

Open models by OpenAI 12 months ago

Do you know when this was introduced (or which paper)? AFAIK it's not that way in the original transformer paper, or BERT/GPT-2

Open models by OpenAI 12 months ago

I looked through their torch implementation and noticed that they are applying RoPE to both query and key matrices in every layer of the transformer - is this standard? I thought positional encodings were usually just added once at the first layer

I think you cropped out the important part of the quote:

It’s rare that I have more than a drink or two in one night.

I don't drink that often any more, but 2-3 drinks in a night, done occasionally is not a problem. I've had weeks where I drink a beer (or two!) every night, and also don't struggle with any alcohol problems.

2 drinks every single night? Leaning that way - and not great for you just from a health/caloric perspective.

One possibility is trying a different form of cardio. I personally don't enjoy running at all... but I love cycling. Running for 30 minutes is super boring, but I can go do a 4-hour ride no problem. If you can't go outside at all, then this won't really help you though.

N,N-DMT is very intense and not to be taken lightly - but you could say the same with LSD, psilocybin, etc. Personally, I am much more wary of large doses of LSD/psilocybin than DMT, in part to the substantially longer duration of the former. Ego death and the complete dissolution of reality makes it harder to have a bad trip

I just googled "car fatalities [alcohol/distracted]" etc, and found either NHTSA or California statistics. All of them could be prevented using modern tech, but considering that we can't even get speed cameras socially/legally accepted I don't see it happening. We just don't have a culture of caring about this stuff in the US, despite >40,000 people dying each year due to traffic fatalities.

[1] https://www.nhtsa.gov/risky-driving/drunk-driving [2] https://www.nhtsa.gov/risky-driving/speeding [3] https://www.nhtsa.gov/risky-driving/distracted-driving