Keras: Fast Deep Learning Prototyping for Python

by fchollet • 11 years ago

151 25 11 years ago

yankoff• 11 years ago

Saw that on a Kaggle forum and been wanting to play with it for a while. Code looks amazingly clean and simple. Keep up a good work!

Just curious if you compared Keras with caffe or torch in terms of performance?

fchollet4• 11 years ago

In terms of speed, I don't have any benchmarks available. But it's using Theano under the hood, which is well optimized and should be very competitive with Torch and Caffe.

When it comes to convolution, it will actually use cuDNN if available, and performance will be slightly better than Torch and Caffe: https://github.com/soumith/convnet-benchmarks#layer-wise-ben...

slagfart• 11 years ago

Is there a guide for using any of these algorithms with a trivial online (i.e. real time) dataset?

fchollet4• 11 years ago

Online learning, if that's what you are trying to do, can definitely be done with Keras. You would basically just feed samples to the model individually or in small batches using the method 'model.train(X_batch, y_batch)'.

If you raise this issue on the mailing list or in the Github discussion, you'll get more help and advice.

dbecker• 11 years ago

I've been trying to follow the Keras development, and didn't even realize there is a mailing list. Could you post a link to it.

pbnjay3• 11 years ago

As someone still nowhere near an expert in deep learning, a little more description of the examples would be great for helping me dive into this. What do the input/outputs look like and which configurations apply best to what situations?

As it is right now I just see acronyms and uncommented code so it doesn't describe much.

fchollet4• 11 years ago

You can find a simpler intro here: http://keras.io/#getting-started-30-seconds-to-keras

Still, following it would require some familiarity with Numpy and scikit-learn (or other libs in the same spirit). As well as some experience with neural networks.

pbnjay3• 11 years ago

Yeah that's what I was referring to - still a lot of missing pieces. What type is X_train or Y_train? a list of dicts? Same question for prediction output?

I know enough about deep learning to grok the overall concepts and structure, but your docs aren't telling me anything about how to ACTUALLY get started with your lib.

taliesinb• 11 years ago

Any support for hyperparameter selection? That's otherwise a bit of a black art. I skimmed the documentation but didn't see it mentioned.

fchollet4• 11 years ago

Not currently. We are looking to introduce easy interfacing with Spearmint, a library which does bayesian hyperparameter search. This should be part of the v1 release.

Fede_V• 11 years ago

Have you taken a look at this ? https://github.com/HIPS/autograd and paper http://arxiv.org/pdf/1502.03492.pdf

They reverse the computation of the gradient to calculate the derivative wrt the hyper parameters.

madisonmay2• 11 years ago

You also might want to check out Whetlab: https://www.whetlab.com/.

shaneofalltrad2• 11 years ago

Anyone get this running in Ubuntu 14 desktop? I have a ton of dependency issues.

madisonmay2• 11 years ago

Yup, got it working on 14.04 here. My guess is you're having issues setting up the scientific python stack. You might want to try the anaconda distribution (https://store.continuum.io/cshop/anaconda/) if you continue having problems, or follow the instructions from the scipy website on installing via apt-get (http://www.scipy.org/install.html). The apt-get install should pull in some binaries and header files that you won't get from pip. After installing from apt-get you can then run the setup.py file and things should go much more smoothly.

The only other apt-get package I remember pulling down was the hd5f headers: "sudo apt-get install libhdf5-dev"

shaneofalltrad2• 11 years ago

Thank you. I think I found most of the set-up complete through apt-get before I noticed this post, but have installed anaconda anyway's to see how that goes. Seems to have everything firing as it should and was a much smoother install.

tekacs• 11 years ago

44 days ago: https://news.ycombinator.com/item?id=9283105

@fchollet: in case you didn't notice the post back then, you might gain something from those comments, too. :)

motters• 11 years ago

Also see https://github.com/bashrc/libdeep-python

albertzeyer• 11 years ago

Never heard about libdeep before. What's special about it? It doesn't even seem to use the GPU.

jebronie• 11 years ago

Python is the PHP of Starbucks customers.

eghri• 11 years ago

Love this package. I was using PyBrain for a recent project, but I had an awful time getting it to work and found the performance equally awful. After stumbling upon Keras, I was up in running in minutes, and the huge performance boost of Theano allowed me to actually finish on time. Thanks for putting this together!

StavrosK• 11 years ago

I think we found the guy who writes all the testimonials on the internet! :P

Keras: Fast Deep Learning Prototyping for Python

Related Stories