HN user

Icathian

1,438 karma

Currently working with: database internals and distributed systems.

Influences: Ecology academia, BigCo analytics, multiple startups, BigTech.

Interests: Systems, networks, databases, and performance optimization.

Hobbies: League of Legends, yoga, programming.

Important: If you are looking at this profile because you thought something I posted was wrong, dismissive, disrespectful, douchebaggish, what have you -- I would really like to hear from you so that I could understand how you got that impression. I won't get mad, I won't "retaliate" I just want to hear what you have to say. It is important to me to communicate clearly and if something I said struck you that way then I failed and I would like to correct it.

Note: Any comments on this site attributed to me are my opinions and not those of any current, past, or future employer. Consider yourself so notified.

Credit to ChuckMcM for this profile format. I liked it enough to steal it!

Posts16
Comments335
View on HN

Yeah, I'm reminded of 15 years ago being told Linux was super secure because people were popping Windows all the time. Turns out it was mostly just a function of effort pointed at the target, and I don't have any reason to believe that's not the case here too.

It is not. They went about 5 years without one of these, and had a handful over the last 6 months. They're really going to need to figure out what's going wrong and clean up shop.

I happen to work at a company that uses a ton of capnp internally and this is the first time I've seen it mentioned much outside of here. Would you mind describing what about it you think would make it a good fit for something like bcachefs?

GPT-5 12 months ago

Anyone who still takes predictive statements from leadership at AI companies as anything other than meaningless noise isn't even trying.

a change in a leaf function in a little file in a random helper module could introduce asynchronocity which propagates all the way up to your `pub fn main`

If this doesn't make the argument that Zig has certainly not defeated function coloring, I don't know what would.

The fact that this change to how my program runs is hidden away in the compiler instead of somewhere visible is not an improvement.

Hosting and operating the autoscaling of the various services (compute, pageserver, safekeeper, storage broker) that it takes to make all that work is complex enough that most folks would rather not. Same as any other "managed X" service.

That's reasonable. I think major restrictions that cause you to need to refactor your code when going from debug to release are a footgun and a half, but that'd at least be defensible.

Less Slow C++ 1 year ago

I would pay some real money for the rust equivalent of this kind of material. Anyone got a book or repo they like and would recommend?

Apache Iceberg 1 year ago

I think this mischaracterizes the state of the space. Iceberg is the winner of this competition, as of a few months ago. All major vendors who didn't directly invent one of the others now support iceberg or have announced plans to do so.

Building lakehouse products on any table format but iceberg starting now seems to me like it must be a mistake.

Cloudberry, last I checked, took their snapshot of all the Greenplum utilities way before the repos got archived and development went private. The backup/restore, DR, Upgrade, and other such seem to leave a lot on the table. I haven't checked in a bit, it's possible they've picked back up some of that progress.

You're completely right, I had the wrong PG version in my memory. Embarrassing, thanks for catching that.

This is mostly correct, but it's worth mentioning that cloudberry substantially predates Greenplum going closed source. It just got quite a boost from that change happening. Different dev team too, afaik none of the original Greenplum team was involved with Cloudberry until very recently.

Also, Greenplum 7 tracks postgres 14. Which is still old at this point, but not so bad as 12....

I also don't think I'd call the architecture ancient. Just very tightly coupled to postgres' own (as a fork of postgres that tries to ingest new versions from upstream every year or two) and paying the overhead of that choice in the modern landscape.

Source: former member of the Greenplum Kernel team.

[dead] 2 years ago

I hadn't heard of this one before, I'm curious what people think. Will any of the C variants aiming to accomplish memory safety actually pick up enough adoption to be taken seriously? I don't think a 5x slowdown is going to fly, but I find the idea in general pretty interesting.

Ultimately I've picked up Rust and am betting on it long term, but I'd be very curious to hear takes from other people.

It's been pulled to close-source by Broadcom now, but if anyone is interested there was a fairly cool from-scratch go implementation of the same basic ideological approach as pg_dump for Greenplum. Fairly cool for seeing the catalog queries it takes to pull each piece of information that goes into a schema, at the very least.

https://github.com/greenplum-db/gpbackup-archive

I only looked at the linked file, so I'm not going to speak to the rest of the code and don't really have a good grasp of the architecture here.

This seems mostly ok. The only thing that (imo) wouldn't pass code review is that big honking loop at https://github.com/achristmascarl/rainfrog/blob/main/src/app.... That thing needs to be refactored down to be readable, with individual logic chunks being put into their own functions and tidied up a bit.

That's not really Rust-specific, obviously, but all the `match` and `if let` and whatever other Rust stuff looks fine, so it's what I've got.