HN user

necubi

7,021 karma

Building the streaming data platform of the future at Cloudflare. Previously founder of Arroyo.dev (YC W23).

My personal code is at github.com/mwylde. My portfolio is at micahw.com.

Also, check out hnhiring.me: a pleasant interface for viewing the monthly "Who's hiring?" posts.

Email: micah@micahw.com Twitter: @mwylde

[ my public key: https://keybase.io/micahw; my proof: https://keybase.io/micahw/sigs/YzolgIEYaIUyGUkHuc3W1XaS5FLgZPDyZRtllICV_Hs ]

Posts70
Comments753
View on HN
www.ft.com 8mo ago

End of The Line: how Saudi Arabia's Neom dream unravelled

necubi
3pts0
blog.cloudflare.com 10mo ago

Cloudflare R2 SQL: a deep dive into our new distributed query engine

necubi
9pts0
www.semafor.com 1y ago

The group chats that changed America

necubi
154pts146
www.arroyo.dev 1y ago

Arroyo (YC W23) has been acquired by Cloudflare

necubi
113pts38
www.arroyo.dev 1y ago

Fast columnar JSON decoding with arrow-rs

necubi
56pts7
sfstandard.com 1y ago

Autopsy: No foul play in OpenAI whistleblower's suicide

necubi
22pts6
www.bloomberg.com 1y ago

Arm is canceling Qualcomm's chip design license

necubi
622pts450
www.nytimes.com 2y ago

After 12 years of reviewing restaurants, I'm leaving the table

necubi
147pts176
www.arroyo.dev 2y ago

Building a dynamic lib plugin system for Rust

necubi
21pts3
koto.dev 2y ago

Koto 0.14 released – scripting for Rust appplications

necubi
3pts0
www.arroyo.dev 2y ago

Building a streaming SQL engine with Arrow and DataFusion

necubi
112pts30
www.arroyo.dev 2y ago

Why Stateful Stream Processing

necubi
2pts0
www.arroyo.dev 2y ago

Can you replace Prometheus with a stream processor?

necubi
2pts0
www.arroyo.dev 2y ago

The semantics of streaming SQL

necubi
2pts0
www.arroyo.dev 2y ago

Why we chose Rust for data infra

necubi
4pts0
cwiki.apache.org 2y ago

KIP-932: Queues for Kafka

necubi
77pts21
www.arroyo.dev 2y ago

Streaming data to S3 is surprisingly hard

necubi
2pts0
github.com 3y ago

Show HN: Arroyo – Write SQL on streaming data

necubi
115pts32
www.arroyo.dev 3y ago

End-to-end SQL tests with Rust proc macros

necubi
2pts0
www.arroyo.dev 3y ago

Open-sourcing Arroyo, our Rust stream processing engine

necubi
8pts0
www.arroyo.dev 3y ago

10x faster sliding windows: how our Rust streaming engine beats Flink

necubi
9pts0
www.theatlantic.com 6y ago

The Search for the World’s Simplest Animal

necubi
2pts1
knobattack.com 6y ago

Key Negotiation of Bluetooth Attack: Breaking Bluetooth Security

necubi
18pts0
spaceflightnow.com 8y ago

Rocket Lab's Electron Rocket Reaches Orbit for First Time

necubi
4pts0
engineering.siftscience.com 9y ago

Reliable Workflow Processing Using Kafka and HBase

necubi
4pts0
www.theawl.com 10y ago

On the Campaign Trail with John McAfee

necubi
2pts0
lists.gnu.org 10y ago

Emacs has a new maintainer

necubi
8pts0
www.theatlantic.com 10y ago

What If the Parties Didn't Run Primaries?

necubi
2pts0
www.bloomberg.com 10y ago

Dell to Buy EMC in Deal Worth About $67B

necubi
201pts63
www.google.com 11y ago

Google Self-Driving Car Project Monthly Reports

necubi
1pts0

ABC was originally designed for European folk music [0], not church music. The corpora as a result is largely fiddle tunes, particularly Irish (see for example https://thesession.org).

ABC started very simple, because most of the performance information for folk music isn't written down, it's inferred by the player according to the idiom of that particular tradition. As usage of ABC has grown it's gotten more powerful but still falls far short of formats designed for western classical, like MusicXML or Lilypond.

[0] https://abcnotation.com/history

MIPS is increasingly common in rock helmets. Black Diamond (anecdotally the most common brand I see in the US) now has it in their higher end models, and Mammut as well.

You do not need perfect pitch to quickly learn fiddle tunes by ear (source: I play fiddle, can quickly learn by ear, do not have perfect pitch). You learn tunes primarily by relative pitch, which most people can develop.

There's also an element of violin-specific pitch detection; if you play violin for long enough, you can recognize the specific timbre of different notes on a violin (particularly easy for open strings) which helps ground you while listening to a tune.

I’m someone who is not a python developer but has to use python tools and run other people’s python code. I have suffered through learning about anaconda, virtualenv, pip, and more. Uv is the first time there’s a tool that just runs the software without requiring me to become a python ecosystem expert

It would be pretty shocking for Amazon to break the S3 API at this point. There is a huge 3rd party ecosystem that would be affected. For example, in Rust land the object_store crate is at least as popular as the official SDK.

Matt Levine has a take: https://www.bloomberg.com/opinion/newsletters/2026-02-24/ai-...

Look, I am sorry. But if you go to Jump Trading and Jane Street and say “hello, I have an unregulated poorly designed mechanism that could lead to $50 billion of market value collapsing overnight, would you like to trade with me,” they are going to say yes, but their eyes are going to light up, you know? If at Time 0 you give them an extremely gameable system that can produce billions of dollars of profit, at Time 10 your system is going to be a smoking wreckage and they are going to have billions of dollars of profit. That’s their whole job, you know? I couldn’t tell you in advance what all the intermediate steps will be, and in fact in hindsight I cannot tell you what the intermediate steps actually were, how Jump and Jane Street made money off the collapse of Terra. But as a heuristic, I mean, come on. Terra was like “hello we have a balloon full of money, here is a pin, dooooooon’t pop the balloon.” Guess what!

I don't think this is meaningfully HTAP, it's gluing together two completely different databases under a single interface. As far as I can tell, it doesn't provide transactional or consistency guarantees different than what you'd get with something like Materialize.

This isn't new either, people have been building OLAP storage engines into MySQL/Postgres for years, e.g., pg_ducklake and timescale.

Cloudflare | Rust/DB engineers | SF/Austin/Seattle/NYC/London/Lisbon (Onsite) | Full-time

Hey HN, I'm hiring engineers for the new Cloudflare Data Platform (https://blog.cloudflare.com/cloudflare-data-platform). We do streaming ingest and processing, managed Iceberg catalogs, and a distributed query engine—all built on R2 and the Cloudflare Edge. We're making it ridiculously easy for Cloudflare customers to build data lakes.

I'm looking for Rust engineers with experience working on databases, stream processing engines, and query engines. You'll get to work on incredibly cool tech on a huge scale.

Note: we are hiring for on-site roles in one of our engineering hubs, not hiring remote at this time.

If you're interested, shoot me an email (in profile) with subject HN and a brief description of your background and interest in the role.

In the same boat, I try it every few months but give up because the emacs mode still isn't good enough. It's been getting slowly, slowly better though.

I moved my startup’s marketing site and blog from NextJS to Astro, and I’m happy with it. It’s in that middle ground—focused on primarily static sites but with the ability to still write bits of backend logic as needed.

I found it hard to get next to reliably treat static content as actually static (and thus cacheable), and it felt like a huge bundle of complexity for such a simple use case.

Sirius DB 7 months ago

One downside is that you're paying for the GPU whether you're fully using it or not. It takes big queries to saturate a GH200, and if you're only using 10% of the capacity of the GPU it doesn't really matter that it's 10x faster.

In a typical company you'll have jobs, some scheduled, some ad-hoc, at a range of sizes. Most of them won't be cost-effective to run on a GPU instance, so you need a scheduling layer that estimates the size of the job and routes it to the appropriate hardware. But now what if the job is too big to run on your GPU machine? Now we either have to scale up our GPU cluster or retry it on our more flexible CPU cluster.

And this all assumes that your jobs can be transparently run across different executors from a correctness and performance standpoint.

There are niches where this makes sense (we run the same 100TB job every day and we need to speed it up), as well and large and sophisticated internal infra teams that can manage a heterogenous cluster + scheduling systems, but it's not mass-market.

I feel like I'm on another planet here. Basically every new piece of software in my space (DB/query engines/streaming engines) is being written in Rust these days. There are like three production projects, total, written in Zig.

Error ABI 8 months ago

If by "exceptions" you're talking about stack unwinding (as opposed to the language-level control flow constructs like throw/catch) then Rust has always had that with panics and panic=unwind.

Error ABI 8 months ago

This doesn't have anything to do with exceptions, and the context appears to be Zig, not Rust.

The article is about how we represent errors not their control flow (i.e., exceptions).

It was the same for me growing up in the shadow of Silicon Valley in the early aughts, post dot com crash. Even when I went to college in 2008 the conventional wisdom was that there weren’t going to be any jobs in software, it was all being outsourced. I studied CS anyways, because I loved it. It was still very hard to get my first job out of college in 2012.

But then from like 2015-2022 things got crazy. Anyone with a CS degree, or even a boot camp certificate, could immediately get a 200k/year job with little effort. And people started to think this was normal, would last forever. But in fact this was a crazy situation, it absolutely could not last.

I feel for the young people who thought (or were told) that CS degrees were an automatic ticket into the upper middle class. But in reality, there’s no such thing.