Natural Language Processing with Deep Learning

http://web.stanford.edu/class/cs224n/

by jonbaer • 7 years ago

210 28 7 years ago

web.stanford.edu

jimmy_dean3• 7 years ago

The machine learning Stanford courses are probably the best open education contributions I've encountered. From Ng's CS229 material to Karpathy's rendition of CS231n. These are some of the best pedagogical materials on machine learning/deep learning available.

ai_ja_nai• 7 years ago

True at heart, I am totally in love with CS231 (Yeung and Johnson)

jimmy_dean3• 7 years ago

That course is really the best blend of theory and application. I find their approach more tasteful than fast.ai's, but to each their own!

discordance• 7 years ago

Unfortunately the videos for this course won't be made available until after the course has finished.

_cs2017_2• 7 years ago

https://youtu.be/8rXD5-xhemo

bitforger• 7 years ago

I still remember Nick Parlante's Intro to CS. Great stuff.

https://lagunita.stanford.edu/courses/Engineering/CS101/Summ...

jimmy_dean3• 7 years ago

Yup! I made heavy use of his codingbat material during 1st year.

https://codingbat.com/java

godelmachine5• 7 years ago

Is there a good course for standalone Natural Language Processing?

I came across MIT OCW’s Advanced NLP - https://ocw.mit.edu/courses/electrical-engineering-and-compu... , but does someone has a similar or a better standalone NLP course in mind? From MIT OCW, Stanford , Coursera, Udacity, et al?

I am very much interested. Could be free or paid.

Even PDF’s of lecture notes could do.

Edit - Found one standalone NLP course by CMU, looks good - http://demo.clab.cs.cmu.edu/NLP/

amy12xx• 7 years ago

Stanford NLP course by Manning and Jurafsky is a go-to for me. https://www.youtube.com/watch?v=3Dt_yh1mf_U&list=PLQiyVNMpDL...

godelmachine5• 7 years ago

Thanks for this :)

alok-g3• 7 years ago

The following is also good:

https://web.stanford.edu/class/cs224u/

While you asked for a course, checkout my introductory presentation on the subject here (PDF slides available for download):

https://www.siliconvalley-codecamp.com/Session/2014/introduc...

An attendee, claiming to have read 1.5 books on NLP, called it the broadest coverage of NLP he had ever seen. Some of the attendees told me that I had inspired them to turn their careers to NLP.

godelmachine5• 7 years ago

Hi Alok,

Thanks for taking interest in my question and responding :)

Your paper sounds very exciting and promising, and I am going to finish reading it over the coming weekend.

godelmachine5• 7 years ago

I skimmed through your PDF. It's very exhaustive and all-encompassing.

But what really got me excited was that you had included 2 of Steven Pinker's books in your "Suggested References". Few weeks ago, I was going over the Wikipedia entry this book by Steven Pinker - "A Sense of Style", and wondering if it has any implications on linguistics.

https://en.wikipedia.org/wiki/The_Sense_of_Style

So, my question to you is, does "The Sense of Style" bears any NLP-relevant context in it?

Thanks for such an awesome PDF :) Can't wait for my day to end!

_cs2017_2• 7 years ago

Great lectures, with a lot of intuition about recent research and clear explanations.

Some videos are already online, starting with https://youtu.be/8rXD5-xhemo

return0• 7 years ago

I also like CMU's neural net for nlp class: https://www.youtube.com/watch?v=pmcXgNTuHnk

piceas• 7 years ago

Skimming through I came across a fun example (new to me at least) in the introduction to translation, lecture 8 slides page 55.

"hn hn hn hn hn hn hn hn hn hn hn hn hn hn hn hn hn hn hn" in Somali gives "Serious Therapic Anxiety syndrome" on google translate.

Perhaps not surprising, but fun. The link from the slide (below) has previously been submitted to hn without notable discussion.

https://www.skynettoday.com/briefs/google-nmt-prophecies

theCricketer2• 7 years ago

I took this class and can vouch for it. They update the class every year to go over recent research - not an easy task in such a fast moving field. For example, this offering covers the Transformer architecture which has recently been used to obtain state of the art results across a wide range of NLP tasks.

roadbeats• 7 years ago

Are you a student at Stanford ? I was wondering if I can join just for this course...

theCricketer2• 7 years ago

The videos from the winter 2017 offering are freely available on YouTube.

https://www.youtube.com/playlist?list=PLqdrfNEc5QnuV9RwUAhoJ...

The assignments are at the class webpage too.

pattusk• 7 years ago

Tangentially related if you're interested in keeping up to date with what's going on in the field:

Sebastian Ruder's blog has many good posts on recent advancements in NLP (literature reviews, conference highlights): http://ruder.io/

The posts are concise and accessible enough that you can skim through them quickly. Then you can go check out the paper directly if something piques your interest.

phowon• 7 years ago

I know this talking point has been brought up by different people, but it's worth pointing out that Transformers were already covered in the class in 2018. https://web.stanford.edu/class/archive/cs/cs224n/cs224n.1184...

k4ch0w• 7 years ago

Chris Manning is responsible for so much work in this field. I can't wait to go through this video series. Thanks for all your hard work and I want you to know how much it's appreciated.

Natural Language Processing with Deep Learning

Related Stories