HN user

killme2008

308 karma

Engineer and petrohead.

github.com/killme2008

Posts25
Comments47
View on HN
blog.fnil.net 1mo ago

Close the Coding Agent Loop

killme2008
2pts0
datafusion.apache.org 2mo ago

Dynamic Filters: 25x Faster Queries by Passing Info Between Operators

killme2008
2pts0
github.com 3mo ago

Universal Claude.md – cut Claude output tokens

killme2008
471pts162
tma1.ai 4mo ago

Show HN: TMA1 – Local-first observability for LLM agents

killme2008
2pts0
www.maffulli.net 4mo ago

AI is the final frontier of Copyleft

killme2008
12pts0
github.com 4mo ago

Open-source GPU virtualization and pooling for Kubernetes

killme2008
3pts0
datafusion.apache.org 7mo ago

Apache DataFusion 51.0.0 Released

killme2008
2pts0
quesma.com 1y ago

Don't Let Apache Iceberg Sink Your Analytics: Practical Limitations in 2025

killme2008
1pts0
medium.com 1y ago

Lessons from Mixing Rust and Java: Fast, Safe, and Practical

killme2008
115pts42
vutr.substack.com 1y ago

Deep dive into the challenges of building Kafka on top of S3

killme2008
2pts0
greptime.com 1y ago

Open-source Rust database tops JSONBench using DataFusion

killme2008
13pts5
greptime.com 1y ago

Rust database achieves top JSONBench ranking

killme2008
7pts0
greptime.com 1y ago

Show HN: GreptimeDB 2025 Roadmap

killme2008
7pts0
www.mclaren.com 1y ago

From Pen and Paper to an AI Factory: McLaren's F1 Reinvention

killme2008
8pts3
nexustrade.io 1y ago

A Two-Year Journey Rebuilding an Algorithmic Trading Platform in Rust

killme2008
1pts0
arxiv.org 1y ago

Reinforcement Learning: An Overview

killme2008
6pts1
dl.acm.org 1y ago

Hints for Computer System Design (1983) – Lampson's timeless principles

killme2008
2pts0
greptime.com 1y ago

Using Rust to Build a TSDB Running Inside a Car

killme2008
2pts0
greptime.com 1y ago

Long Term Prometheus Storage at a Fraction of the Cost

killme2008
2pts0
github.com 1y ago

Define Clojure functions with parameter pattern matching just like Erlang

killme2008
3pts0
github.com 1y ago

Unified time series database for metrics, logs, and events written in Rust

killme2008
1pts0
greptime.com 1y ago

A Review of Databases in the IoT Era

killme2008
2pts0
greptime.com 2y ago

Exploiting Cloud Object Storage for High-Performance Analytics

killme2008
1pts0
greptime.com 2y ago

Error Handling for Large Rust Projects

killme2008
3pts1
www.greptime.com 2y ago

GreptimeDB v0.4 Launched: Save TimeSeries Data in Cloud

killme2008
1pts0
[dead] 1 month ago

An open-source, cloud-native observability database released v1.0 after four years of hard work.

[dead] 6 months ago

Hi HN — I’m the creator of GreptimeDB. We just shipped v1.0.0-rc.1 (our first 1.0 release candidate / feature-freeze milestone).

Highlights:

Online region repartition (SPLIT/MERGE) to adjust partitions at runtime (distributed clusters; shared object storage + GC).

Faster Metric Engine PK filters via memcomparable byte comparisons (microbench: ~20–90× on dense codec).

PromQL planner prefers TSID (skips unnecessary label columns).

Would love feedback from folks running observability/time-series workloads, especially on upgrade paths + repartition behavior in real clusters. GitHub releases/changelog: https://github.com/GreptimeTeam/greptimedb/releases

Logging sucks 7 months ago

This thread overlaps a lot with "Observability 2.0 and the Database for It" (https://news.ycombinator.com/item?id=43789625). The core claim there is: treat logs/spans as structured "wide events", and build a storage/query layer that can handle high-cardinality events so many metrics become derived views rather than pre-modeled upfront. It also argues the hard part isn't "dump it in S3", it’s indexing/queryability + cost control at scale.

In an agentic AI world this pressure gets worse: telemetry becomes more JSON-ish, more high-cardinality (tool names, model/version, prompt/template IDs, step graphs), and more bursty, so pre-modeling every metric up front breaks down faster.

I can't believe they made this decision. It's detrimental to the open-source ecosystem and MinIO users, and it's not good for them either, just look at the Elasticsearch case.

[dead] 8 months ago

Hi HN, I'm Dennis from Greptime. This article is based on a talk by our engineer Ruihang Xia, who is also a PMC member of Apache DataFusion.

The most surprising finding for me was the hash seed trick - using the same random seed across HashMaps in a two-phase aggregation gives you ~10% speedup on ClickBench. The bucket distribution from the first phase can be preserved during merge, eliminating rehashing overhead and making CPU cache happy.

We also discuss why Rust's prost library can be significantly slower than Go's protobuf implementation, and how fixing it improved our end-to-end throughput by 40%.

Happy to discuss Rust performance optimization or DataFusion internals.

Glad to see that Ruby Under a Microscope is still being updated. It’s an essential read for anyone who wants to understand how Ruby works internally — and I truly enjoy reading it.

I didn’t mean SQL over PromQL — they’re designed for different layers of problems. SQL has a broader theoretical scope: it’s a general-purpose language that can describe almost any kind of data processing or analytics workflow, given the right schema and functions.

PromQL, on the other hand, is purpose-built for observability — it’s optimized for time‑series data, streaming calculations, and real‑time aggregation. It’s definitely easier to learn and more straightforward when your goal is to reason about metrics and alerting.

SQL’s strengths are in relational joins, richer operator sets, and higher‑level abstraction, which make it more powerful for analytical use cases beyond monitoring. PromQL trades that flexibility for simplicity and immediacy — which is exactly what makes it great for monitoring.

Hi there, I’m from the GreptimeDB team.

Thank you for giving GreptimeDB a shout-out—it means a lot to us. We created GreptimeDB to simplify the observability data stack with an all-in-one database, and we’re glad to hear it’s been helpful.

OpenTelemetry-native is a requirement, not an option, for the new observability data stack. I believe otel-arrow (https://github.com/open-telemetry/otel-arrow) has strong future potential, and we are committed to supporting and improving it.

FYI: I think SQL is great for building everything—dashboards, alerting rules, and complex analytics—but PromQL still has unique value in the Prometheus ecosystem. To be transparent, GreptimeDB still has some performance issues with PromQL, which we’ll address before the 1.0 GA.

[dead] 8 months ago

A technical discussion on the limits of current observability stacks and what a merged data model could look like.

[dead] 1 year ago

Insight: Claude Code uses Haiku model for lightweight tasks, Opus for complex ones.

Really fascinating story—thanks for sharing! Graphics programming has been a major driving force behind the widespread adoption of object-oriented programming, and the abstraction of devices in this context is truly elegant.

This article summarizes our experience from a commercial project that runs on an in-vehicle Android system. In this project, we needed to invoke Rust code(DB) from Java(App), so we couldn't directly use the project’s source code for demonstration. Instead, we created a demo project: https://github.com/GreptimeTeam/rust-java-demo

1. I agree that using Rust doesn't necessarily mean faster performance; it simply gives you the opportunity to implement some compute-intensive modules in Rust, which is a possible approach.

2. This is a great suggestion, and we organized our project in the same way. You don’t need to use unsafe for every call. However, if you want to call JNI APIs from Rust, unsafe is required.

3. Sorry, some details were missing here. We use AsyncRegistry(Java) as an intermediary. Before initiating an async operation in Rust, we need to call Java code in advance to register a future and obtain a unique future ID. After the async execution completes, we retrieve the registered future by its ID, and then complete it or complete it exceptionally depending on the async result. You can refer to this code: https://github.com/GreptimeTeam/rust-java-demo/blob/90ffa0ba... and https://github.com/GreptimeTeam/rust-java-demo/blob/90ffa0ba...

4. This article was not generated by AI; it’s just that our official blog has a fixed template at the end. Sorry for the inconvenience.

Yes, so many startups are trying to solve the log issue in the current stack.

In my personal observation, the vast majority of startups are still focused on the product layer and use ClickHouse directly for storage. However, ClickHouse’s tightly coupled storage and compute architecture makes it difficult to scale, and this becomes a real problem as workloads grow. GreptimeDB, on the other hand, is more focused on being an all-in-one observability database. Our log UI, however, still has quite a gap compared to products like Kibana.

This space is very crowded. I think it’s unlikely that any new startup will succeed here unless it can first solve its own business use case exceptionally well.

Would love to hear your thoughts.

In fact, we have an open-source query language, but it's still in experimental, so we don't present it on the website. The description of the enterprise feature is not precise. Sorry for the inconvenience.

GreptimeDB also open-sources the log view UI if you read the article.

I agree with you that ETL is so powerful, and GreptimeDB is so young, we still have lots of work to do. Thank you.

I completely agree with you—Rust is not well-suited for application development. Application development requires rapid iteration, acceptable performance, and most importantly, a large developer community and a rich software ecosystem.

Languages like Go , JavaScript, C# or Java are much better choices for this purpose. Rust is still best suited for scenarios where traditional system languages excel, such as embedded systems or infrastructure software that needs to run for extended periods.

Yes, GreptimeDB requires a time index column for optimized storage and querying. It's not a constraint of a primary key, but just an independent table constraint.

Could you elaborate on why you find this inconvenient? I assumed logs, for example, would naturally include a timestamp.

Agree. Leveraging capabilities provided by cloud vendors is always a good idea. However, as the scale grows, cost inevitably becomes an issue. Third-party solutions often offer cost advantages because they support multi-cloud deployments and are optimized for specific scenarios.

Thanks for your question. GreptimeDB, like MongoDB, is schemaless. When ingesting data via OTEL or its gRPC SDKs, it automatically creates tables by inferring the schema and dynamically adds new columns as needed.

Secondly, I prefer wide tables to consolidate all sources for easy management and scalability. With GreptimeDB's columnar storage based on Parquet, unused columns don't incur storage costs.