Train Your TensorFlow Models on Rescale

https://blog.rescale.com/train-your-tensorflow-models-on-rescale/

by gpoort • 10 years ago

88 23 10 years ago

blog.rescale.com

icinnamon• 10 years ago

Helpful FYI: If you're interested in learning about Machine Learning (so you can use TensorFlow and Rescale, etc), I've found this to be an incredible resource: https://www.coursera.org/learn/machine-learning/

ganeshkrishnan• 10 years ago

If you specifically want to learn about tensorflow then you can enrol for this course by Google https://www.udacity.com/course/deep-learning--ud730

ilyaeck• 10 years ago

Rescale pricing: "Price as low as $0.04/core/hour" - if I am reading this correctly, training on a K40 Nvidia GPU (with nearly 3000 cores) amounts to about $100/hour. Bit pricey, no? Or am I not reading this right?

trhway• 10 years ago

the real price is "request for quote", so your number seems to be in the ballpark :)

nl• 10 years ago

I'd assume that is priced per CPU core (never seen anything priced per GPU core).

From memory the $0.04/hour is the base price for EC2 GPU spot instances.

kramimus5• 10 years ago

Yes, you are correct. All our pricing is currently by CPU core. We are working on updates to make pricing more clear for GPU offerings.

Our rate for a single K40 at the moment is $6/hr.

(works at Rescale)

gcr3• 10 years ago

EC2 GPU spot instances average around $0.20 per hour in the cheapest region. On-demand instances are $0.65 per hour.

isseu• 10 years ago

How can I install a custom python package? I've been using tflearn for my models, is there any way to use it?

kramimus5• 10 years ago

Yes, you can install custom packages.

We can probably also add tflearn to the base tensorflow install so you don't have to set it up yourself.

Feel free to contact me directly at the email in my profile for more info on this.

modeless3• 10 years ago

The GPU chip is Nvidia's GK104, which was released in 2012. Amazon's GPUs are similarly old. You'll train models twice as fast with a Titan X installed in your local machine, without having to deal with distributing the training.

When will we see the first cloud machine learning provider with up-to-date GPUs?

matheweis• 10 years ago

Is it? Their website (http://www.rescale.com/pricing/) says they have Kepler K520 and Tesla K40. No affiliation with them at all, and haven't logged in yet, but I've been looking for something like this too, so I was hopeful until I saw your comment...

gpoort• 10 years ago

It is not the only hardware on Rescale. K520 and K40 are definitely available - after you create a free account and login there is a very transparent price list of the hardware available to you.

(works at Rescale)

kramimus5• 10 years ago

Yes, I agree, that hardware is aging. We are currently working on making K80s available and should be ready in the next couple months.

(works at Rescale)

modeless3• 10 years ago

K80 is still Kepler based. Why not Maxwell?

betelgeusem• 10 years ago

Nervana Systems http://www.nervanasys.com/products/ is using Titan X's for their cloud.

modeless3• 10 years ago

Interesting. Does that require you to use Neon though? Also, seems like a "contact us for quote" kind of situation.

gcr3• 10 years ago

How much RAM do GK104 chips have? Wikipedia seems to imply it's about 3GB, but that's even smaller than EC2 GPU instances' 4GB. Many modern models really need the maximum 12GB to train.

kleer001• 10 years ago

Good point. Especially for me as I'm not quite up to date with knowlege about all the GPU business (other than they're screamingly fast)

It's still scads faster than my 8 year old laptop that I'm stuck with at the moment.

Train Your TensorFlow Models on Rescale

Related Stories