HN user

theOGognf

68 karma
Posts5
Comments23
View on HN

I feel like both this comment and the parent comment highlight how RL has been going through a cycle of misunderstanding recently from another one of its popularity booms due to being used to train LLMs

The Company Man 10 months ago

I really enjoyed it. Very Hitchhiker’s Guide -like. It’s been a while since I’ve read something like that. Thanks for sharing

Dreamer 4 10 months ago

I used to follow advancements in RL pretty closely since 2016; it’s cool to see how far methodologies and algorithms have come to be able to do complex tasks completely offline. Dreamer 4 is another big leap in the Dreamer series

Along the same lines of missing good junior engineers at work, we occasionally interview stellar engineers that’ve inflated their resume a bit to get an interview, but we end up rejecting them for not having all the specific experiences our manager wants them to have even though they’re generally great and could clearly upskill where necessary. No wonder we can’t grow the team when we’re out here looking for unicorns

This article is pretty good. My current work is transitioning CV models in a large, local hospital system to a more unified deployment system, and much of the content aligns with conversations we have with providers, operations, etc..

I think the part that says models will reduce time to complete tasks and allow providers to focus on other tasks is on point in particular. For one CV task, we’re only saving on average <30min of work per study, so it isn’t massive savings from a provider’s perspective. But scaled across the whole hospital, it’s huge savings

It’s ironic that HN threads, arguably one of the forums where the majority of users should understand a tech company and its tech, about Palantir always devolve into some weird speculative and conspiracy-like discussion. Palantir’s docs are pretty open too - it’s not like it’s a black box that you can only see if you have a contract with them. So one would think the HN crowd would know something and have an interesting discussion on how it compares to what they’ve seen, etc. But it somehow always turns mostly political and less about the tech

I’ve used Diesel for a bit now but haven’t had issues wrangling the type system. Can you give an example of an issue you’ve encountered?

Along with burning tokens, how MCP servers are ran and managed is resource wasteful. Running a whole Docker container just to have some model call a single API? Want to call a small CLI utility, people say to run another Docker container for that

Feels like a monolith would be better

LLMs are cheap 1 year ago

Right, this is only power usage. Factoring in labor and all that would make it more expensive for sure. However, it’s not like it’s a complex system to maintain. We use a popular inference server and just run it with some modest rate limits . It’s been hands-off for close to a year at this point

LLMs are cheap 1 year ago

Some anecdotal data, but we recently estimated the cost of running a LLM at $WORK by looking at power usage over a bursty period of requests from our internal users and it was on the order of $10s/mil tokens. And we arent a big place, nor were our servers at max load, so I can see the cost being much lower at scale

Ive come to like coding in Rust a lot more than any other language Ive tried. It is really nice having a ton of tooling out of the box that helps the development experience (formatting, linting, rich compiler errors and suggestions, etc). I also like the way options and errors are handled. At first, I found it annoying that you have to effectively unpack or match anytime you have an error, but I’ve come to enjoy that strictness because it just made the development more confident

Clap isn’t too bad. It feels a lot like argparse in Python, so it felt familiar. I did like the functions it exposes and the customizations it has as it helped me use it for matching against poker commands in the TUI