HN user

spenczar5

4,818 karma

spencer nelson

firetiger.com, previously twitch/aws, i like woodworking

s@spencerwnelson.com

Posts49
Comments707
View on HN
blog.firetiger.com 3mo ago

Agent Engineering Patterns: Dealing with large tool results

spenczar5
3pts0
blog.firetiger.com 4mo ago

Dynamically making agents to monitor PRs

spenczar5
2pts0
www.bigsandwoodworking.com 1y ago

Making Tansu Hardware by Hand

spenczar5
2pts0
tailscale.com 1y ago

The New Internet

spenczar5
2pts2
technicaldatasheets.3m.com 2y ago

Nuclear Grade Duct Tape

spenczar5
4pts2
grocerylists.org 2y ago

The Grocery List Collection

spenczar5
1pts0
wordsandbuttons.online 2y ago

Check if your performance intuition still works with CUDA (2021)

spenczar5
1pts0
journal.spencerwnelson.com 2y ago

The Case for Smaller Telescopes

spenczar5
3pts3
en.wikipedia.org 2y ago

The Goodyear Massively Parallel Processor

spenczar5
5pts0
www.traditionalkayaks.com 2y ago

Typology of Traditional Arctic Kayaks

spenczar5
2pts0
github.com 2y ago

Atree: A simple and efficient pointer-free tree implementation

spenczar5
251pts105
en.wikipedia.org 2y ago

Merkle's Boner

spenczar5
2pts0
github.com 2y ago

Quivr: Beyond Dataframes for Python Data Engineering

spenczar5
1pts0
journal.spencerwnelson.com 2y ago

Quivr: Improving DataFrames for Software Engineering

spenczar5
2pts0
www.science.org 2y ago

Cyberattack shutters major NSF-funded telescopes for more than 2 weeks

spenczar5
90pts42
www.nytimes.com 2y ago

Killer Asteroid-Spotting Software Could Help Save the World

spenczar5
4pts0
github.com 3y ago

Cpython/Lib/Antigravity.py

spenczar5
2pts0
journal.spencerwnelson.com 4y ago

Reverse engineering the 1988 NeXT keyboard protocol

spenczar5
239pts61
www.thecrimson.com 4y ago

Facemash Creator Mark Zuckerberg Survives Ad Board (2003)

spenczar5
1pts0
hbr.org 4y ago

The High Price of Efficiency (2019)

spenczar5
4pts2
security.archlinux.org 4y ago

CVE-2021-4102: RCE in Chromium actively being exploited

spenczar5
9pts0
www.youtube.com 4y ago

The Mess We're In – Joe Armstrong (2014)

spenczar5
3pts0
journal.spencerwnelson.com 4y ago

The Airport Delay Fallacy

spenczar5
11pts4
journal.spencerwnelson.com 5y ago

Making a faster Avro Python library with eval

spenczar5
1pts0
noirlab.edu 5y ago

SATCON1 Report on Impact of Satellite Constellations on Astronomy

spenczar5
87pts109
blog.twitch.tv 7y ago

Go memory ballast: How I learned to stop worrying and love the heap

spenczar5
10pts0
blog.twitch.tv 8y ago

Twirp: A new RPC framework for Go

spenczar5
368pts97
medium.com 8y ago

How to hack the UK tax system: a 3 step guide to a 57 day journey

spenczar5
2pts0
www.digitaljournal.com 8y ago

Researchers shut down AI that invented its own language

spenczar5
2pts2
www.hollywoodreporter.com 10y ago

Twitch Sues Over Bots Artificially Inflating Broadcasters' Popularity

spenczar5
2pts1
Resetting Xbox 16 days ago

This is still $150M of pure gravy every single year.

The issue is rate of return. They are evidently spending $4.85bn on Xbox per year. The US federal interest rate is 3.5% so if you just put that money in US bonds you would get about $175M per year of much purer simpler gravy.

Sometimes you get there by accident. You make a thing, it grows or is used in unexpected ways, now suddenly performance matters.

Sometimes Python is just the language used in the domain. Lots of sciences live on Python because it is easy to teach to grad students and the package ecosystem is strong.

It's in the first sentence of your quote:

"our continued collaboration with Anthropic"

Read this as: "we get discounts, rate limit increases, a direct line to responsible product managers; in exchange we participate in friendly marketing." It's extremely common in this line of business - typical of database vendors, software tool companies, etc.

That's a pretty interesting idea! I guess 160+ is sort of doing some of that for us - it compiles to SQL WHERE clauses, right - but generally, we found good results giving it a SQL dialect directly.

I think some of the reason is that there's so much coverage of writing SQL in its training set.

Yes! This works really well from Sonnet 4.5 onwards, in our experience. Sonnet 4.0 was a little rocky - we had to give it tons of documentation - but by now it works without much effort.

One thing that works very well is just giving it one or two example valid programs/statements in the custom language. It usually picks up what you're getting at very quickly.

When it slips up, you get good signal you can capture for improving the language. If you're doing things in a standard agent-y loop, a good error message also helps it course-correct.

"Cheap" how? I have a friend who works on Seattle's bus planning. Removing a stop is a _lot_ of political work. When an elderly person depends on that bus stop being within a block so they can get to their doctor, and you're proposing to move it six blocks further away, that's essentially a _political_ cost.

It might better in the system throughput, and those benefits may even outweigh the misery put on that one person. But in the US, we largely sort that out by using cool-down times, hearings, and "community input."

Net result, according to my friend at least, is that bus stops feel _very_ sticky and hard to change.

Clicks Communicator 7 months ago

I feel like I see an independent low-noise phone project like, every 3 months. Clearly there is some latent demand here. I wonder why the big players (Google, Apple, Samsung, HTC) haven't made a big-corp product for this market.

I am always reluctant to jump on with these independent ambitious projects. The first version is understandably rough, and the company seems to fold before they get to a second or third version.

But maybe advances in manufacturing in China are making high-quality, small-batch products like this more tractable?

"But accepting the full S3Client here ties UploadReport to an interface that’s too broad. A fake must implement all the methods just to satisfy it."

This isn't really true. Your mock inplementation can embed the interface, but only implement the one required method. Calling the unimplemented methods will panic, but that's not unreasonable for mocks.

That is:

    type mockS3 struct {
        S3Client
    }

    func (m mockS3) PutObject(...) {
        ...
    }
You don't have to implement all the other methods.

Defining a zillion interfaces, all the permutations of methods in use, makes it hard to cone up with good names, and thus hard to read.

Thanks for the detailed answer!

I use DuckDB today to query Iceberg tables. In some particularly gnarly queries (huge DISTINCTs, big sorts, even just selects that touch extremely heavy columns) I have sometimes run out of memory in that DuckDB instance.

I run on hosts without much memory because they are cheap, and easy to launch, giving me isolated query parallism, which is hard to achieve on a single giant host.

To the extent that its possible, I dream of being able to spread those gnarly OOMing queries across multiple hosts; perhaps the DISTINCTs can be merged for example. But this seems like a pretty complicated system that needs to be deeply aware of Iceberg partitioning ("hidden" in pg_lake's language), right?

Is there some component in the postgres world that can help here? I am happy to continue over email, if you prefer, by the way.

Very cool. One question that comes up for me is whether pg_lake expects to control the Iceberg metadata, or whether it can be used purely as a read layer. If I make schema updates and partition changes to iceberg directly, without going through pg_lake, will pg_lake's catalog correctly reflect things right away?

I think I don't understand postgres enough, so forgive this naive question, but what does pushing down to the remote tables mean? Does it allow parallelism? If I query a very large iceberg table, will this system fan the work out to multiple duckdb executors and gather the results back in?

Frankly, yes.

The models are one part of the story. But the software around it matters at least as much: what tools does the model have access to, like bash or just file reading or (as in your example!) just a cache of files visited by the IDE (!). How does the software decide what extra context to provide to the model, how does it record past learnings from conversations and failed test runs (if at all!) and how are those fed in. And of course, what are the system prompts.

None of this is about the model; its all "plain old" software, and is the stuff around the model. Increasingly, that's where the quality differences lie.

I am sorry to say but Copilot is just sort of shoddy in this regard. I like Claude, some people like Codex, there are a bunch of options.

But my main point is - its probably not about the model, but about the products built on the models, which can vary wildly in quality.

Isn't the original post about servers? A minimal client doesn't help with server security.

I would endorse your idea, though, speaking more broadly! That does sound useful.

I dont know, arguing that http/2 is safer overall is a... bold claim. It is sufficiently complex that there is no standard implementation in the Python standard library, and even third party library support is all over the place. requests doesn't support it; httpx has experimental, partial, pre-1.0 support. Python http/2 servers are virtually unavailable at all. And it's not just Python - I remember battling memory leaks, catastrophic deadlocks, and more in the grpc-go implementation of http/2, in its early days.

HTTP 1.1 connection reuse is indeed more subtle than it first appears. But http/2 is so hard to get right.