HN user

drchaim

134 karma

All in between Python, Web and Data.

mailto : daniel at chimeno.me

Posts0
Comments95
View on HN
No posts found.

WHEN do you move to Redis/Memcached? None of my projects have exceeded 1000 rps at peak, and in none of them have I felt the need to move from unlogged PostgreSQL tables to Redis.

Just trying to get a sense of where people draw the line.

Brandur of course knows more than me, and his framing sounds correct. I would be worried about whether the TAM of Go + Postgres is enough for business sustainability, but that says probably more about my fears than the reality in this huge market called “internet”

Pre-2022 Books 1 month ago

This will happen with social accounts, news articles..I set the date pre 2023, but we all have some date in mind. I don’t like it, but it’s what it is

Actually, there was no search, only on-the-fly aggregations/filtering over "big data". ES was kind of famous at the time, although not the best tool for that job.

afaik CH introduced FTS rececently.

I discovered ClickHouse around 2017-18 and built a PoC to replace Elasticsearch: 5x better storage and qps, in a couple of weeks.

Managers rejected it because it wasn't well known and was seen as "some database made by Russians."

On a personal level, it's quite sad to have seen that train coming so early and not been able to get on board.

I've tested the migration of the main table (IoT data), from 300GB to about 25GB in a non-production environment. Everything seems right, but I'm still delaying/procrastinating the prod migration, so I wanted to know how it is going for other live projects.

Good stuff, although I’m not quite sure about the fast OLAP use case.

If you’re already sharding by tenant for other reasons, OK… But I see CDC to a true OLAP system as more scalable.

PostgreSQL still needs real columnar tables in the core, hopefully one day

Actually seems like a good idea. It's like when I use a 2012 laptop. I can't last more than 30 minutes on it. Probably a LAN proxy that throttles the network for some devices...