The Reliable Web App Pattern for .NET

https://devblogs.microsoft.com/dotnet/introducing-the-reliable-web-app-pattern/

by sebazzz • 3 years ago

10 5 3 years ago

devblogs.microsoft.com

hdlothia• 3 years ago

Cache aside looks very interesting

jiggawatts2• 3 years ago

Hilariously, adding retries to applications can make them “bi-stable”, where they can get stuck in a faulty overload state.

This isn’t for writing reliable web apps, it’s compensating for Azure’s slow database offerings.

In an era where I can buy 1 million IOPS for a few hundred dollars, I have to write code to compensate for the few hundred IOPS that I can buy from Azure for thousands a month.

“But, but, cloud storage is different and not at all comparable to an NVMe drive” — you’re about to say.

Yes. I know. That’s my point.

sebazzz• 3 years ago

It seems crazy to me that you need to solve such infrastructure concerns at the application level. I'm really interested how this works in a large scale application. Are retries sprinkled throughout the code base? Especially for database stuff, as EF Core doesn't support transactions when retries are enabled.

I bet these resiliency issues and the fact you need to modify your application didn't make it into the cloud sales talk. I also don't see many resources mentioning it.

Is this also mainly an Azure problem or does it also happen on AWS?

jiggawatts2• 3 years ago

Generally this kind of thing is needed for all clouds, but Azure SQL has a few additional issues in some SKUs.

It all stems from the decreasing “IOPS per TB” as mechanical drives get bigger. Large scale multitenant hosting uses up all available IOPS, which means it has to be carved up and meted out carefully.

Years of this being the status quo set an expectation that the availability of modern SSDs hasn’t yet eliminated. Everyone is used to services with throttled throughputs of a few hundred operations per second in an era where this should be a few hundred thousand…

fatnoah• 3 years ago

This doesn't really feel like much of a revelation. Retry w/circuit breaker and cache-aside are things I was doing almost 20 years ago, and others long before that.

The Reliable Web App Pattern for .NET

Related Stories