Dive into Machine Learning with Jupyter and Scikit-Learn

https://github.com/hangtwenty/dive-into-machine-learning

by stared • 11 years ago

204 33 11 years ago

bobmichael• 11 years ago

Could someone with industry/academic experience in ML comment on the quality and reliability of the resources in the repo?

tdaltonc• 11 years ago

The quality of Scikit-Learn? It's not bleeding-edge but it's very well tested and documented. Quite good quality.

No one gets fired for using Scikit.

hangtwenty8• 11 years ago

I'm curious if you can speak more to this, or share any resources about it. It seems clear that scikit-learn is a good fit for this kind of hacking-learning. If there's a way I can throw in a sentence (with link to more detail), giving context about where it sits in the eyes of experts ... Would be nice.

stared• 11 years ago

It's a nice list of resources for starting. General tools he mentions are both easy to start and are used in practice; also, I like the overview part.

But most importantly - it's not a dump of all possible links, making a daunting list "I will never go through".

Source: I run workshops introducing to ML and Big Data (http://workshops.deepsense.io/, next one in London) and I made a lot of choices converging with this one (Python + scikit-learn, everything in Jupyter Notebook, etc). Also, a lot of links there is already in my delicious list of things I am sending to friends wanting to jump into data science (and many of them were already on the HN main page).

BTW: See also discussion on the same post on DataTau: http://www.datatau.com/item?id=10093

aprdm• 11 years ago

Would you say that Machine learning is something only for PhDs and very experienced people or can a dev pick it up and be hired as one?

xtacy• 11 years ago

Like any topic/skill, it can be learnt, but only if you spend significant time and effort by doing projects, exercises, asking questions (stackexchange, etc.). It's very important to pay attention to fundamentals and thinking from scratch rather than mastering a laundry list of tips/tricks, because fundamental ideas can be composed in different ways and adapted to a new situation. The fundamentals here would be probability, statistics, linear algebra, optimisation.

rahmaniacc2• 11 years ago

I started my career in machine learning with absolutely no knowledge in it. It is definitely some thing that you can learn on the job. You do need a background in linear algebra/ statistics to understand the theory behind different algorithms that will help you decide what algorithm to choose (SVM vs Random Forest for ex.).

Like suggested in the other comment, the best place to start is probably by working on projects with open data sets. Try experimenting with different algorithms, feature engineering techniques. This is especially important because there are plenty of algorithms and identifying which algorithm works for which kind of data set is useful.

IndianAstronaut• 11 years ago

I started with no ML experience per se, but I already had a background in linear algebra, differential equation modeling and stochastic processes.

peterhadlaw• 11 years ago

How does an academic introduction and study in Machine Learning compare to a self taught one? I know it's a shallow question but there has to be some sort of line where the difference opens and closes opportunities.

will_pseudonym• 11 years ago

Another way to look at it would be that the difference opens opportunities to improve the self-taught path.

manish_gill• 11 years ago

I'd love one such list about AI in general and other sub-fields like NLP/Computational Linguistics as well. I've recently started the Berkeley AI course on EdX along with Russell & Norvig's standard textbook. :)

rahmaniacc2• 11 years ago

https://github.com/josephmisiti/awesome-machine-learning

This is a really good list of resources on Machine learning and has a section dedicated to NLP/Text mining.

hangtwenty8• 11 years ago

Thank you, now I've added a link to this in the appendix about finding libraries.

hangtwenty8• 11 years ago

You may find this section relevant. https://github.com/hangtwenty/dive-into-machine-learning#man...

sandGorgon3• 11 years ago

Are there any quality ML courses (of norvig or ng quality) that uses python or java.

I would love to learn ML concepts, but I really don't have the cognitive bandwidth to learn a new language, which I most likely will never use in my day job (Python, ruby,java).

When I last looked, most of the top quality courses use some variant of proprietary tools or MATLAB, but production code is in python or java (with R sometimes).

GFK_of_xmaspast• 11 years ago

Learning a new language is very easy compared to learning all sorts of other stuff, including ML.

sandGorgon3• 11 years ago

I agree - the problem is that there are some problems at my work that I can probably solve by applying some concepts of ML. But I dont think I can do that through matlab.

I have been having a bad day on HN, so before I get misconstrued - there is nothing wrong with matlab. I was just hoping a go-to-production language like Java or Python for learning ML.

Bouncingsoul1• 11 years ago

If the author is here, thank you very much for providing this. I wanted to to look it into Jupyter and machine learning and this is probably the right way to start. I tried the course one Udacity for machine learning (Python, Scikit-Learn) but it not my way of learning things,since I like to fiddle around instead of going the straight way . If anyone is interested in an alternative check out the Udacity coure https://www.udacity.com/course/machine-learning-supervised-l... .

hangtwenty8• 11 years ago

Author here. Thank you! Glad you find it useful!

olympus• 11 years ago

I'll add my thoughts on the topic of "how do you know when you're out of the danger zone and can start marketing yourself as a machine learning expert?"

Do competitions on kaggle (or find them on other sites, but kaggle is definitely the best place to start). Once you get past the point where you are finishing in the middle of the pack (multiple top 10% or 25% finishes and maybe a prize win) then you are an expert. That is proof that you are separate from than hackers who just throw scikit-learn algorithms at a matrix. The people in the master tier use clever feature engineering and/or code up custom learning algorithms to get themselves above the masses. Looking at a problem and figuring out the correct modeling approach is what the experts do. They don't just create a data frame and run down the list of classification algorithms that they have access to. Read the "No Free Hunch" reports on how the winners did it and you'll quickly see the difference between yourself and the experts.

hangtwenty8• 11 years ago

This is a fantastic contribution, thank you!

I opened an issue ... https://github.com/hangtwenty/dive-into-machine-learning/iss...

I'll wait a bit in case you want to add a note on this in your own words (via PR). Otherwise, tonight or tomorrow I'll paraphrase you or something. Whether you or I make the change I want it in a branch, and then I'll try to get a bit of review for that branch ...

THANKS AGAIN, the guide really needs some insight like this.

_of• 11 years ago

For those interesting in picking up machine learning that already know R, I recommend this book:

http://www.amazon.com/Applied-Predictive-Modeling-Max-Kuhn/d...

It's loaded with useful R snippets and practical examples.

hangtwenty8• 11 years ago

TIME SENSITIVE note --

The guide's primary recommended course is Andrew Ng's Machine Learning course. Current session started November 2nd, you must enroll by the 7th. Another session is starting November 30th.

https://www.coursera.org/learn/machine-learning

Cheers!

argonaut4• 11 years ago

It's not time-sensitive at all. After the course has ended, you can still enter the course and do everything; you just won't get the certificate (which doesn't matter).

hangtwenty8• 11 years ago

Good point, people should know that.

What I had in mind is that some people get a lot from the the community features on Coursera, more active while a class is in session. So that's all I meant.

metamet• 11 years ago

What exactly is the appeal of the certificate? Do they hold any weight?

TDL• 11 years ago

Thank you for this! I've started digging in to ML and this looks absolutely awesome.

Dive into Machine Learning with Jupyter and Scikit-Learn

Related Stories