Yeah came here to comment exactly this. And this is generally why I dislike/avoid this type of first principle analysis: it can make very convincing arguments that are just totally wrong due to some misleading assumption
HN user
tipsytoad
https://tom-pollak.github.io/
1.0 is actually pretty arbitrary and way too high as a general rule. Something like 0.3 is a more sensible default
And yet the monologue is a complete work of fiction, a script delivered by a talented actor that we still find moving. So what are these authentic experiences to you, or does it not matter if we can’t tell the difference?
Curious how they do a “blind” preference test. To any evaluator I’m sure it’s quite clear which answer is AI vs human.
Who designs a website like this?
We can use jj now, thank goodness. But I still miss my old git workflows + lazygit
I joined gdm recently, and previously used (neo)vim exclusively. Begrudgingly Cider-V is very, very good. It might be possible to get by without it, but the system is so locked down you’re going to make a lot of sacrifices. (very few authorised extensions, codebase is so large it’s going to break whatever tools your used to using anyway, no git)
I’m well thinking I may as well trade my brick of an m5 pro for a 13” chromebook, it’s a strange time.
As someone who basically only hangs out on HN, what are the trends on Reddit? I thought it would vary by channel
Throughput is a metric for the total number of tokens/sec for all users in the system. Latency (ITL,TTFT) are individual user metrics.
The guys previous post was how rabbit r1 is revolutionising the smartphone. So I would take this post with a grain (heap?) of salt
Made it to the 5th stage of grief
While I large agree, when I rely too much on agentic llm usage I come away feeling that I haven’t really learnt much over the session, and the code wasn’t really “mine”. It’s also easy to let your skills atrophy over time if you’re not careful, and for the hardest / interesting problems I often turn the llm off entirely and write out the code by hand, and come out a lot happier than just guiding Claude
Someone not familiar with the field rediscovering the stochastic parrot argument from 3+ years ago
Clearly not from the UK. By US standards Labour would be socialist, and conservative (right) liberal at best.
It’s a quite deceptive paper. The main headline benchmarks (math500, aime24 /25) final answer is just a number from 0-1000, so what is the takeaway supposed to be for pass@k of 512/1024?
On the unstructured outputs, where you can’t just ratchet up the pass@k until it’s almost random, it switches the base model out for instruct, and in the worse case on livecodebench it uses a qwen-r1-distill as a _base_ model(!?) that’s an instruct model further fine tuned on R1’s reasoning traces. I assume that was because no matter how high the pass@k, a base model won’t output correct python.
I get the same feeling that I'm "not being productive" while playing video games, watching tv, etc that seems to kill any enjoyment from doing these things.
For me learning piano has been a great alternative to programming in the off hours (typing is quite transferrable too!). Highly recommend if you're like me on screens all day.
Like, PyTorch? And the new Mac minis have 512gb of unified memory
I usually am a huge fan of “copilot” tools (I use cursor, etc) and Claude has always been my go to.
But Sonnet 3.7 actually seems dangerous to me, it seems it’s been RL’d _way_ too hard into producing code that won’t crash — to the point where it will go completely against the instructions to sneak in workarounds (e.g. returning random data when a function fails!). Claude Code just makes this even worse by giving very little oversight when it makes these “errors”
I wholly disagree with the comic, but a anti AI art take I’m more sympathetic to: https://x.com/soi/status/1815584824033177606?s=46
I don’t think this hits at the heart of the issue? Even if we can catch AI text with 100% accuracy, any halfway decent student can rewrite it from scratch using o1s ideas in lieu of actually learning.
This is waay more common and just impossible to catch. The only students caught here are those that put no effort in at all
Just another +1 that if you’re going to give vscode a fair shot, it’s much better to go with vscode-neovim than the standard vim extension. You can even map most of your config right over.
E.g. (mine) https://github.com/tom-pollak/dotfiles/tree/master/nvim
How is this different from instructor? github.com/jxnl/instructor
namely, why did they take so long for something that just seems like a wrapper around function calling?
Looks really nice, but the only concern I had — how does the perf compare to more mature libraries like faiss?
The most useful feature of llms is how much output you get from such little signal. Just yesterday I created a fairly advanced script from my phone on the bus ride home with chatgpt which was an absolute pleasure. I think multi-prompt conversations don't get nearly as much attention as they should in llm evaluations.
Switched to Firefox a month or two ago, mostly for ublock origin on android, and unlimited history (seriously, why is this not the standard?)
I've tried to like it but honestly it's been painful. MacOS Sonoma seems to have a hover bug, which has been unresolved through the last 3 bug fix updates. Performance is "fine" but seems to lag with many tabs open which was never an issue in chrome (this is on an M2 pro!) PDF reader also seems significantly slower as well. At this point I'm considering going back to chrome.
Moved to vscode with the neovim extension (vim mode was slow for me over large files). vsc is super customisable, and you can remove all the tab bars, side panels and anything else you don't use fairly easily. It's also far more stable than the neovim ecosystem, i don't have time to mess with neovim plugins breaking bi-weekly anymore
Using fzf through bash history and using # comments as tags on common commands seems to work just as well for me. Not sure what else this adds
Eh, you can probably get very similar to fish with zsh + loads of plugins, but fish has lots of niceties out of the box (syntax highlighting, autosuggestion based on your directory). I've been using fish + starship with just a fzf plugin and it's got everything I need.
Check it out, it's effective with very little config
Priding ;)
So like an autoencoder for text?