PostgreSQL on ARM-Based AWS EC2 Instances

https://www.percona.com/blog/2021/01/22/postgresql-on-arm-based-aws-ec2-instances-is-it-any-good/

by timf • 6 years ago

208 62 6 years ago

booi• 6 years ago

The author makes it pretty clear this isn't a comparison of ARM vs. x86 but with the specs being nearly identical, I'm finding it very hard not to draw that conclusion. The difference is even larger when you factor in the cost difference.

Are there other factors that could explain the large performance gap?

chrischen• 6 years ago

I think what they mean is that there are enough non-CPU differences that you can't make this an accurate comparison. That being said at the end of the day the ARM instances are cheaper and better performing—whatever the reason may be.

wmf2• 6 years ago

The SSD is clearly different. Are there other differences, or are people just assuming?

random56343• 6 years ago

But the non CPU differences (compiler / linker / OS optimizations), number of drives etc - all seem to favor x86?

random56343• 6 years ago

Cost is a key factor. It should be trx/$. That really makes clear the ARM advantage here.

Additionally the ARM version only had one disk vs two for x86.

I also feel like there is more headroom for optimization now that ARM is more visible as a server class target in the non-postgresql toolchains.

Thaxll2• 6 years ago

It's a wrong measurement because not all workload can be "shardable". If your workload is bound to a single instance it does not really matter if it's a bit cheaper.

Not every workload are behind a loadblancer, so single core / MT / single instance performance can be important.

hrez2• 6 years ago

the specs being nearly identical

graviton2 are real cores while amd/intel is SMT vCPU's. So 2x real cores difference.

STRML• 6 years ago

Sure, but it's also 20% cheaper to get the ARM setup, so I don't think it's fair to discriminate this way. In the end what matters is what I can buy, and ARM both offers more cores per socket and per dollar.

fb03• 6 years ago

Has anyone here made the jump? I'm considering testing some components or our infrastructure on Gravitron processors but going all the way in with the database sounds risky but I don't really have a technical data point to justify my bias.

uncledave• 6 years ago

I’ve played with graviton instances and compiled a few bits of C I use for benchmarking. Not a scientific test but I found them to be good but nowhere near the performance per core as the intel offerings. As a comparison they are nowhere near the Apple M1 either. But that doesn’t mean they’re a bad option.

I think they end up close to same price/performance as the Intel offerings as well once you invoke the compiler optimiser. The main benefit is better core scalability and lower energy usage which may work out as a net gain for database workloads.

As always it’s best to measure these things yourself with your expected workload.

luhn• 6 years ago

Gravitron's value prop is you get 2x the physical cores for a slightly cheaper price. Intel wins at single-thread performance, but for parallel workloads Intel's hyperthreaded vCPUs can't keep up.

But you're right in that in the end it all depends on your workload.

NikolaeVarius• 6 years ago

I use it with RDS. If something fucks up, you can always blame AWS. Otherwise have had no issues with it.

Alex39172• 6 years ago

Has anyone here made the jump?

Waiting for the t4 instances.

floatboth3• 6 years ago

Uh, they've been available for several months now.

https://aws.amazon.com/blogs/aws/new-t4g-instances-burstable...

rafaelturk• 6 years ago

We did is and is amazing! All the claims are true and worth it. If your stack is Linux Based you can be up and running within hours: Our stack is based on NodeJS, PostgreSQL, Nginx, Redis, MongoDB, MySQL

e1g• 6 years ago

FWIW, our experience was different: I benchmarked our Node apps on C6g, C5n, and M5zn and found Graviton to be 10-25% slower in our CPU-bound NodeJS code than the same code on x86. Graviton give you better relative performance per dollar, but for absolute single-thread performance M5zn is still the best choice for us.

philipkglass• 6 years ago

I made the jump on one of my databases soon after Graviton 2 was officially supported on RDS. I'm running a small (~500 GB stored data) DB on db.m6g.large with PG 12.4. It's a tiny bit cheaper and performs modestly better than the Intel based instance it was running on before. There haven't been any problems or externally visible changes since the switch.

random56343• 6 years ago

For my side projects waiting for them to do the burstable / cheaper versions in RDS. It's a bit funny that the cheaper chip is not available in the cheaper instance options - seems like that would be a good market (whoever is too cheap to do M instances etc).

Edit: T4g's are available on EC2.

acdha• 6 years ago

I moved ElastiCache & RDS instances over. A bit faster, a bit cheaper exactly as expected and no time required other than a “terraform apply”.

asadawadia• 6 years ago

https://blog.aawadia.dev/2021/01/06/upgrading-pg-10-to-12/ wrote a bit about it

lfittl• 6 years ago

When using pre-built Postgres packages on modern ARM platforms, like the author of this post is, double check that the Postgres binaries are actually using the ARMv8.2 assembly instructions.

This can make a significant performance difference, and at least for the RPM-based official Postgres packages this is a problem: https://www.postgresql.org/message-id/CACN56%2BP1astF5zvocrT...

Abishek_Muthian• 5 years ago

Thanks, that might explain something I'm wondering for a while now.

I was running Postgres on a 2-core/2GB ARMv8 scaleway instance and had to migrate to AWS T2 micro (1-core/1GB)x86 when scaleway pulled the plug on ARM servers.

I expected performance decrease due to obvious reduction in HW specs, but on the contrary the application is much snappier. I don't have PG bench figures, but I can clearly notice performance improvements (discounting the network variables).

arronax• 5 years ago

One of co-authors here. Yes, I expected that to be a huge problem, but, at least for Ubuntu (or, I guess, deb packages), it seemingly wasn't. Which is a pretty big deal, as I doubt a lot of people compile their own PostgreSQL. Trying to push PG on ARM platform to a limit would be an interesting exercise, though, and could necessitate a custom build.

jpitz• 6 years ago

I would have liked to have seen a comparative bonnie++ benchmark - those SSDs are not the same.

zaptheimpaler• 6 years ago

Does anyone know if/when ARM is coming to GCP? Seems like a no-brainer for many use cases and our company would love to move, but we don't have the resources to manage multiple clouds for now.

legoogyawaworht• 6 years ago

As of around 2020H2 Google had nothing in the works for their own main CPU hardware. The ASIC engineers there are mostly focused on proprietary ML hardware like dragonfish, positron etc that have more comparative advantage to do in-house.

tyingq• 6 years ago

Since Google doesn't appear to be working on anything like Graviton, they would have to use a smaller player like Ampere or Nuvia. Marvell says they are out of the general purpose market, and will only work in partnerships for custom chips.

Maybe the M1 success will cause some players to re-think things, but for now, there doesn't seem to be an easier path for competitive high-end ARM servers apart from what Amazon is doing.

gigatexal• 5 years ago

Nuvia, at least according to Ben Thompson of Stratechery, is not going to making server chips. I guess that’s not to say they can’t given a big enough order but it is his belief that Qualcomm bought them to focus on consumer devices and things.

deadmutex• 6 years ago

You could try N2D (Which is AMD): https://cloud.google.com/blog/products/compute/announcing-th... .

The benefit of N2D is that it's still x86, so your existing binaries should work.

Disclosure: I work at Google.

Twirrim• 5 years ago

Can't speak to GCP. I work at Oracle on OCI, their cloud platform. ARM is on its way, based on Ampere Altra chips, which are looking really competitive.

https://www.phoronix.com/scan.php?page=article&item=ampere-a... https://www.phoronix.com/scan.php?page=article&item=ampere-a...

I'm genuinely excited to get my hands on these systems, and see how well they can do. There has been so many promises of a future based on ARM powered servers, and claims about their advantages, and it finally seems like it's within reach from a performance perspective. Whether they'll meet the other expectations, I couldn't guess, but this surely has to be concerning for Intel.

Thaxll2• 6 years ago

Since DB are very often "single" instance you should use what scale vertically best which is x86 based.

yjftsjthsd-h• 6 years ago

single instance != single core/thread

wmf2• 6 years ago

Thaxll is not wrong and shouldn't be downvoted. Vertical scaling means more cores, not higher single-thread performance. Because Graviton is limited to 1-socket systems, EC2 has x86 instances that are larger than the largest Graviton. Whether you'll ever need those is workload-dependent.

cwyers• 5 years ago

Well, no, he is wrong. Postgres can run on either x86 or ARM. You can do replication between them, no problem. There's no reason to run workloads on x86 just to get access to larger instance sizes at some point down the road. You can migrate Postgres on ARM to Postgres on x86, it's not even hard. Use what works best for you now and in the part of the future you have some visibility on. AWS might well announce bigger Graviton instances before you ever get there, if you ever get there at all.

kondro• 6 years ago

Given the storage formats are identical, you should choose the most cost-effective option for your workload now and scale that to larger machines (ARM or x86_64) when it’s justified.

I promise you, you’ll know with plenty of time to spare before you’re going to hit the current 64-core limit of Graviton before you need to decide if you can fit into a 128 vCPU (which I believe are hyper threads not cores) x86_64 instance.

maxpert• 5 years ago

Is it me or I see intel going down the PowerPC route now. I never imagined a niche micro-computer like acorn computers do something so revolutionary.

rsanheim• 5 years ago

With this sort of architecture switch for a database, would there be any reason to switch dev environments to use an ARM build of PSQL (where possible) as well to match production? PostgreSQL is often a core piece of apps that rely on it, but it sounds like this sort of change may be pretty much seamless from the application layer perspective.

rovr138• 5 years ago

Assuming you don’t mean developing for Postgres, not really.

The api developers will be using will be staying the same. It’ll be transparent.

For a staging server, I would. Just to be as close to prod as possible and actually have the same environment and packages to debug against if needed.

darksaints• 5 years ago

Has anybody tried out PostGIS on gravitron yet? I'd love to switch over, but I'm a little worried about what I'll run into.

sandGorgon• 5 years ago

We are having a persistent issue on ARM RDS instances of postgresql. They don't come up after a reboot. Each time, we had to file support tickets and get the customer support to fix it.

They said it was happening because of load, which is a falsehood, since I'm talking about a machine coming up after a reboot.

There is something broken on ARM on AWS there. And even after multiple tickets, they aren't able to fix it

ksec• 5 years ago

While ARM-based instance is 25 percent cheaper, it is able to show a 15-20% performance gain in most of the tests over the corresponding x86 based instances.

To put this into Workload per Dollar. Graviton 2 on AWS is roughly 50% to 60% cheaper. Now not every workload will benefits, there are many CPU intensive workload especially those benefits from SIMD won't work as well on current Graviton 2. But there are enough workloads especially those dealing with Web Stack has shown huge cost savings.

Hopefully this add perspective when people are thinking Intel's Server Platform is still relatively safe. I wrote something about it here [1].

[1] https://news.ycombinator.com/item?id=25808856

PostgreSQL on ARM-Based AWS EC2 Instances

Related Stories