Ask HN: What is the best database structure to store Big Data?

https://news.ycombinator.com/item?id=34726414
by mafiaboi • 3 years ago
1 6 3 years ago

Asking HN data engineers for opinions and recommendations:

I am building on top of the blockchain data using Google Cloud and Bigquery however the queries for most of the data is just too slow and takes a long time.

I believe there is huge improvement in database tools as well as new DBs popping up. Are there any recommendations that I can implement to make my SQL queries much faster?

Two that I came across is trino.io and Apache Spark. Anyone used these before and saw noticeable performance changes?

Related Stories

Loading related stories...

Source preview

news.ycombinator.com