Amazon EC2 EU-West is down

https://news.ycombinator.com/item?id=2857296

by dabeeeenster • 15 years ago

109 31 15 years ago

news.ycombinator.com

Nothing yet on the AWS service status but Twitter is going a bit crazy.

UPDATE 19.15 BST: now being reported as network issues by Amazon

UPDATE 19.24 BST: Can now see my ec2 instances again from the management console but can't ssh into most of them.

UPDATE 19.27 BST: From Amazon: EC2 APIs in the EU-WEST-1 region are currently impaired. We are working to restore full service. We are also investigating instance connectivity that we believe to be limited to a single Availability Zone.

UPDATE 19.34 BST: RDS and Route 53 also affected.

UPDATE 20.10 BST: From Amazon: The issues with the affected Availability Zone are the result of a power failure in that zone. We are currently recovering power and anticipate that instances in the effected available zone will start to recover within the next 30-60 minutes.

Well, that sucks.

dabeeeenster• 15 years ago

I can SSH to some of my newer instances but not the older ones.

pimeys• 15 years ago

I can see my server from the management console but I can't ssh to it. Damn, my IRC is down :(

sipefree• 15 years ago

Clear skies over Dublin, not a cloud in sight. ;)

sdepablos2• 15 years ago

I see all my servers on the management console, but I'm unable to ssh any of them, all in the same availability zone, eu-west-1b

dialtone• 15 years ago

CloudFormation is also affected now.

stephank2• 15 years ago

The specific availability zone they're talking about is eu-west-1a. Servers we have there are reported as 'running', but are unresponsive.

Other zones seem fine, but starting new servers doesn't seem to be working.

amock• 15 years ago

Availability zones are different for different accounts, so for me it's eu-west-1b. You can log into the console and under the EC2 tab it will show you the status of each of your availability zones.

stephank2• 15 years ago

Ah, good to know, thanks for the pointer.

Another update on the status page, btw. It appears to be a power failure.

jread• 15 years ago

I run a site that monitors over 100 different cloud services. Our monitoring node in EC2 EU West went down at 10:48:51 PDT. Our monitored application with PHP PaaS cloudControl, also hosted in EC2 EU West, went down at the same time. For the past year, we've gotten 99.978% availability in this EC2 region: http://cloudharmony.com/status

jimmyjim• 15 years ago

Power outage?

Interesting -- Linode also went down today because of power outage: http://status.linode.com/2011/08/outage-in-fremont-facility....

bradly• 15 years ago

Is there any chance these power failures have something to do with the solar storms we are experiencing right now?

techiferous• 15 years ago

They have subsided. Note the K-index on this page: http://spaceweather.com

whakojacko• 15 years ago

This is what, the 3rd? 4th? power outage in that facility in the last year? I realize that it's not directly Linode's fault, since this is Hurricane Electric's facility that they lease from, but its still pretty frustrating. I have a personal VPS there which I use to do an hourly data grab, so I missed a few this morning. This is just a personal pet project so no huge deal, but if I was running some actual production-level stuff there I would be very wary of using that facility.

getsat4• 15 years ago

Linode doesn't notify their customers affected by outages, or am I missing something?

Macha2• 15 years ago

I've been notified for what amounted to two minutes of downtime before (my VPS is in the London data centre). Are you in the Fremont data centre? That is where this outage was.

hrasm• 15 years ago

They don't. They do have an RSS feed that you can monitor with your favourite feed aggregator: http://status.linode.com/rss.xml

puredemo• 15 years ago

So that's what interrupted my screen session.

bambax2• 15 years ago

THANK YOU HN!!! I couldn't connect to my machine and couldn't understand what was going on... good thing I turn to HN as soon as I get online...

You'd think AWS could afford to send emails to keep us customers up to date with the problem?

rwolf• 15 years ago

If they sent you an email every time there was downtime, then you would know every time there was downtime. Any time your servers are not available but you don't notice == win.

bambax2• 15 years ago

> Any time your servers are not available but you don't notice

Can't happen. My servers are monitored by external services that (to the best of my knowledge) don't use AWS.

It's best to play the open card in any case.

spartango• 15 years ago

Emails will be sent out when the problem is more fully handled, as usual. HN is a decent place to get some info, but you should consider posting to the AWS developer forum as well, b/c there are Amazon people constantly checking on things and answering questions:

https://forums.aws.amazon.com/forum.jspa?forumID=30

Edit: I should add, they can look up your specific instances to get the exact problem.

chaz• 15 years ago

A must-follow Twitter feed for anyone using Amazon AWS is @ylastic: http://twitter.com/#!/ylastic

At the very least, even if you don't use Twitter, it's a good resource to check for up-to-the-minute info if you're seeing an issue and want to verify.

calpaterson• 15 years ago

If anyone is interested, ServerDensity thinks that our machine went down between 6:37 and 6:42 BST.

rmc• 15 years ago

As an AWS customer affected by this, that's the time our servers went dark.

1SockChuck• 15 years ago

Looks like a lightning strike in Dublin knocked out power at data hubs for Amazon and Microsoft: http://news.ycombinator.com/item?id=2858239

zizzler• 15 years ago

Has anyone gotten any timeframe when the rest of the RDS is going to start responding? Not much info on the status page of AWS.

Amazon EC2 EU-West is down

Related Stories