Auto Scale your Heroku Apps with Hero Scale

https://www.heroscale.com

by railsjedi • 16 years ago

69 48 16 years ago

heroscale.com

StavrosK3• 16 years ago

Wait, why doesn't Heroku itself do this?

humanimality• 16 years ago

Because it has many other things to do.

patio11• 16 years ago

For an enterprise: autoscaling is either not a value add ("You can cut $40 a month off our $300 hosting bill? Absence of 'yay'.") or Really Freaking Hard And App Specific. SmugMug, as I recall, did a lot of work to dynamically spin up and shut down instances to minimize their bill (not a Heroku app, obviously), because their usage patterns consistently predicted high load for workers at certain times and low loads at other times.

For a ramen-munching startup: shaving $40 off our bill is very motivating. However, while we have dreams of scaling up, if you actually do it we're going to wig out when we see a four figure hosting bill. By the way, we're pathological customers who understand just enough of this to be a danger to ourselves, and we will blame you on the Internets when your system does exactly what we tell it to do.

StavrosK3• 16 years ago

I see your point, but why would a startup wig out when they scale? Presumably, revenues would scale with demand, so I would be quite grateful that my provider allowed me to satisfy the demand quickly and reliably...

notahacker• 16 years ago

Because its profit margins depend on clients provisioning at least a little more capacity than they need.

enoptix3• 16 years ago

I think this is a great idea however it would seem that this is more of a feature than a business. What happens when Heroku implements this feature themselves?

P.S. Love the website design, it really pops!

railsjedi6• 16 years ago

Hah, yep. I've been waiting for this feature from Heroku for over a year. Finally decided to just implement it ourselves. We then realized it might be nice to make it easy for other people.

We'd welcome Heroku implementing it! We actually think there's many other things we can add on top of Heroku that would be valuable so we're not too worried :-)

jollyjerry• 16 years ago

the landing page design really grabbed me, but I'm also really impressed with how simple and functional the actual dashboard is when you login. I had signed up with another beta autoscaling service, but I never heard back from them again. Best of luck with the service! I'll be rooting for ya.

blaisco• 16 years ago

Autoscaling Heroku workers is definitely a problem that people would like solved, but I see a few issues with trying to offer the solution as a SaaS. One, you're targeting developers. There are several github repos that do this kind of thing for free, and developers would know how to find and implement those. Two, those github repo's are going to do a better job of scaling because they can turn dynos/workers on and off instantly (e.g. as soon as a delayed job is done); much more cost effective than waiting up to 5 minutes to turn dynos/workers on/off. Three, you're targeting people that are trying to save money and _don't_ want to spend money.

As an aside, perhaps I (a cheap developer) am not in your target demographic, and you're really targeting folks with lots of Heroku apps and lots of money to spend. In which case you should be charging bundles more than $20/month.

railsjedi6• 16 years ago

Yep, I tried all the open source autoscaling heroku tools on Github. They were not easy to use, and had major problems (try them, you'll see!)

I think Heroku users value their time above all else. There's much cheaper ways to host your Rails apps. This tool allows Heroku users to save money while not having to spend days getting their autoscaling stuff working and tested.

enoptix3• 16 years ago

This one works exceptionally well with Resque:

https://gist.github.com/501160

aaronbrethorst• 16 years ago

Pedro's DJ fork[1] has worked quite well for me. What didn't go well with it for you?

[1] https://github.com/pedro/delayed_job/tree/autoscaling

runT1ME• 16 years ago

>>I think Heroku users value their time above all else. There's much cheaper ways to host your Rails apps. This tool allows Heroku users to save money while not having to spend days getting their autoscaling stuff working and tested.

Then charge more!!!

I mean, you just said it yourself, your target market values time over money. Don't try to compete on price then. right? :)

richardburton2• 16 years ago

Threw an error when I tried to connect my Heroku account :(

richardburton2• 16 years ago

Lovely graphics though.

ihunter3• 16 years ago

Fixed, was redis issue.

heffay• 16 years ago

Tried to add my Heroku account and got the typical rails 500 error:"We're sorry, but something went wrong."

EDIT: Refreshed and it seemed to work!

knodi2• 16 years ago

David Dollar that works at Heroku already wrote a (free) gem that auto scales your heroku apps.

https://github.com/ddollar/heroku-autoscale

enoptix3• 16 years ago

That is only for dynos, not workers.

stephth• 16 years ago

I feel those who point "free" alternatives to Hero Scale have never actually tried to auto-scale their dynos. That gem is not a serious alternative.

David Dollar worked on it for one day and then never committed anything again (except for three months later, one little note: "This gem is a proof of concept and should not be used in production").

In my experience this gem crashes requests frequently (502 errors if I remember well). I don't know what's going on in that code - I wasted some time looking into it with no luck - but something in there is flawed.

Heroku is supposed to be simple. The idea of Heroku is you can focus on the design of your apps. Auto scaling turned out to be a huge pain and waste of time for me. I ran out of patience and moved my Ruby code to the Google App Engine.

doorty• 16 years ago

This is a great idea. I looked at the auto scaling repositories on GitHub: 1) There wasn't a good solution for Rails 3 yet. 2) The GitHub repos were typically forks of existing repos (like for CollectiveIdea's Delayed Jobs) and therefore would not always be up to date. I wouldn't be too worried about Heroku implementing this (though I hope they do) because there isn't a direct incentive for them to save you money by auto scaling. I'm definitely going to try this out.

Kudos• 16 years ago

"App crashed"

Looks like it couldn't scale to the hacker news traffic. Is that Irony?

cmelbye• 16 years ago

It would be if that error meant that the app couldn't handle the traffic. "App crashed" just means that their code is doing something weird and the thin process crashed.

dclaysmith• 16 years ago

Ouch. "App crashed" messages not the best marketing for an auto-scaling app.

uggedal• 16 years ago

Seems like they did not scale heroscale.com itself. All I get is:

  App crashed

  This application is temporarily offline.

  If you're the administrator of this app,
  please check your heroku logs for the backtrace.

axod3• 16 years ago

I get a bad ssl cert warning.

jroes2• 16 years ago

Yep. SSL cert warning on Safari for iPhone.

railsjedi6• 16 years ago

Minor launch glitch. Fixed now :)

Definitely not related to scaling. Just couldn't connect to our redis server after we upgraded it.

meskyanichi• 16 years ago

Negative Nancy. Ever heard of the "Backlog too deep" error? That's a scaling issue, not the error you mentioned.

colinplamondon• 16 years ago

We drop $500-800/month on Heroku, so I just signed up to give it a shot- doesn't take a lot of savings to make it worthwhile.

axod3• 16 years ago

Isn't Heroku supposed to auto-scale EC2?

So we have Heroscale autoscaling Heroku which autoscales EC2??

Am I missing something?

ihunter3• 16 years ago

Yes and no. Right now, if you're running at one dyno then you're pulled from the heroku "mesh" if you run idle. However, this is a free account so it's not really saving you any money.

Heroku doesn't auto manage your dyno and workers based on usage. You set dynos at 10, you're running 10 throughout the month. Likewise with workers.

Heroscale ramps your dynos and workers up/down based on necessity.

tpz2• 16 years ago

Since the site doesn't describe this in any detail: can you define 'necessity'? In other words, can you tell us anything about how and when your service decides to scale up or down, for dynos and for workers? And what have you done to avoid porpoising (to borrow an aviation term for lack of a better option coming to mind at the moment.)

Also, can your service scale workers all the way down to zero and then spark up the first worker upon the next job submission? Or can it only scale workers as low as one?

knodi2• 16 years ago

I'm not sure I want to give my Heroku account password to an external service.

railsjedi6• 16 years ago

We're working on a heroku proxy API that will allow people to hook into heroscale via oath.

jeffio• 16 years ago

Yes, I will probably wait for oath before signing up and checking it out.

kineticac• 16 years ago

This looks pretty cool. As a startup, any savings is worth it. Problem is, my app is too matured to try a few things that aren't proven / stable yet. I will wait to see if Heroku official includes this as an add-on. If so, I'm totally down.

I could implement it myself, but if it's coming and implemented by a team who's dedicated a lot more time than I can, then it's worth it.

endlessvoid94• 16 years ago

App Engine is the only service that gets this 'auto scaling' right. Unfortunately the rest of the service sucks.

Auto Scale your Heroku Apps with Hero Scale

Related Stories