Ask HN: S3/Cloudflare R2/GCS/Wasabi/B2/Bunny or Minio/Seaweed/Garage/Ceph?

https://news.ycombinator.com/item?id=39895205

4 7 2 years ago

news.ycombinator.com

Seems like a few of the non-AWS S3 object storage services (even big ones like R2) have had some production issues.

Anyone care to describe their experiences?

I'd like to store billions of smallish files (photos etc) in production. Price (incl bandwidth) is important, but uptime and latency (where S3 does suffer) are more important.

gramakri22• 2 years ago

Cloudflare DNS seems to be down at the moment :-) The API calls return "null" as the result like `'{"result":null,"success":true,"errors":[],"messages":[],"result_info":{"page":1,"per_page":100,"count":0,"total_count":0,"total_pages":1}}'`

gunapologist992• 2 years ago

So, Cloudflare DNS API is down!?

It might be irrelevant but their core product (of returning results), i.e. dig google.com @1.1.1.1 seems to be working fine here.

gramakri22• 2 years ago

Looks like this was just some random failure! All looks good now. I was looking at HN for cloudflare errors and your was the first :)

Well, it turns out https://developers.cloudflare.com/api/operations/dns-records... now returns "null" in result . I think it returned empty array before.

speedgoose• 2 years ago

I would add https://github.com/gaul/s3proxy and https://lakefs.io/ to your list.

gunapologist992• 2 years ago

Thanks, checking them out now!

colesantiago• 2 years ago

I always trust S3, tried and tested. The others aren't really production ready or proven.

antongribok• 2 years ago

You're mixing software defined storage options with public cloud offerings, which is kind of strange.

If you have your own hardware, Ceph is solid.

I wouldn't put more than 200 million objects in a single bucket, but other than that it can be very reliable.

I have ~ half an exabyte on-prem, and sleep very well at night.

Ask HN: S3/Cloudflare R2/GCS/Wasabi/B2/Bunny or Minio/Seaweed/Garage/Ceph?

Related Stories