Show HN: Cache for S3

by acstorage • 1 year ago

8 7 1 year ago

Ins’t accelerated S3 just a CDN?

acstorage4• 1 year ago

The purpose is different in that ACS is meant for datacenter workloads. ACS is optimized for both fast reads and writes to Object Storage. The architecture is different than a typical CDN.

bob1029• 1 year ago

https://aws.amazon.com/s3/storage-classes/express-one-zone/

acstorage4• 1 year ago

Hey, there are a couple differences between ACS and S3 Express One Zone.

One is speed, ACS provides up to 5X better performance (latency/throughput) than S3 Express One Zone. We have benchmarks repo here: https://github.com/Accelerated-Cloud-Storage/Benchmarks. Please let me know if you have any questions on this.

Another aspect of this is that ACS buckets are modeled on the traditional S3 bucket structure not the directory buckets of S3 Express One Zone. ACS buckets are not stored in only one availability zone and can be accessed in a performant manner from a region different than the region/az of bucket creation.

everfrustrated• 1 year ago

So it's redis with an S3 API? Because "AI".

acstorage4• 1 year ago

I understand your frustration with some of these AI startups, and there is a lot of hype in this space. However, there are a couple meaningful differences between ACS and Redis.

One difference is the engineering effort for integration. If an SWE was using Redis they would have to create custom polices on when to move the data between S3 and Redis, how to store it, for how long and when to move newly written data back to S3. This can impose a significant amount of engineering effort for a team. Redis is also mostly single-threaded whereas ACS is designed from the ground up to be multi-threaded.

Another difference is the interface. ACS is accessible through an S3 compatible Python/Go SDK or a high-performance FUSE mount for a POSIX-like file system interface. With Redis, you would still have to build an interface around it for other engineering teams or customers to use.

acstorage4• 1 year ago

The service is currently available in US-East-1 on AWS. We plan on launching multi-region AWS support and SOC2 compliance soon. This should give companies the assurance to use ACS to store their data and the flexibility to use it wherever they are deploying their GPUs in AWS.

Show HN: Cache for S3

Related Stories