Advanced NLP with SpaCy

https://course.spacy.io/

by jonbaer • 7 years ago

357 36 7 years ago

course.spacy.io

acconrad• 7 years ago

I'm using NLP with Spacy for my slack bot and it's awesome! Glad to see they're offering a more advanced course to use their library.

avmich• 7 years ago

Does it handle dialogs?

syllogism2• 7 years ago

GitHub repo: https://github.com/ines/spacy-course

Might also be interesting to others who have DataCamp courses they'd like to release free.

kyllo2• 7 years ago

So should I not take your DataCamp course anymore? Probably not, no.

Here's some context for anyone who's wondering why: https://noamross.github.io/datacamp-sexual-assault/

taneq• 7 years ago

Without further elaboration on what "uninvited physical contact" means, this smells like manufactured outrage. It's definitely not right to conflate uninvited contact with sexual assault this way, because that trivialises actual sexual assault.

tasubotadas• 7 years ago

Where did the good old way of calling them pieces of shit and just leaving the job go?

Apparently, now it is also necessary to get someone fired and/or closing the business entirely.

jpdus• 7 years ago

Unpopular opinion here:

I followed the outrage about Datacamp loosely on Twitter. At first I thought it was about an actual assault, but so far afaik the only thing publicly known is "uninvited contact", on a dancefloor and the victim reported that several months later.

Sexual assualt or abuse is a crime and should be punished and prosecuted. However, if we treat every situation where two people interact physically and have a different understanding of their relationship as sexual assault, there won't be any sexuality without a written consent form in the future anymore and real victims get marginalized at the same time. I don't know if that is really what we should be aiming for.

I don't see Datacamps reaction as inappropriate in this case,at least if there is nothing more to the story behind the curtain. Humans do errors and in most cases everybody should get a second chance. One moment of misjudgment can be enough today to get fired, you name gets burned forever in the Internet and your life can get turned upside down. And I don't know if that helps the victim in any way.

Probably I will be downvoted for that, but I want to make clear again that I don't tolerate this behaviour in any way and I think the industry needs to be more inclusive and diverse. I just think that you have to differentiate and that public shaming is not on all cases a good solution.

didymospl2• 7 years ago

Thank you for the clarification. I don't want to further speculate about the issue but as as annual Datacamp subscriber I am wondering what effect could it have on the service. I guess it means sharp drop in new courses but what about the existing ones, could the authors remove them from the platform?

charlescearl• 7 years ago

Many thanks to Ines for releasing not only the tutorial but the framework! Sharing and ethics has always been a hallmark of the spaCy team.

_fx6v• 7 years ago

Curious how people are using SpaCy in production with constant improvement of the model and how that workflow happens from user input & review.

anentropic• 7 years ago

This is very nicely presented. Kudos!

growlist• 7 years ago

Mordecai uses SpaCy and is worth a look for extracting place names: https://github.com/openeventdata/mordecai

I wasn't too successful running it against tweets (low hit rate/false positives, low spatial resolution) but geolocating tweets is a hard problem and I'm sure it would work better against more structured text.

rpedela2• 7 years ago

Are you using the pre-trained NER models or your own? If the former, I wouldn't expect it to work well on tweets since it wasn't trained on them.

amrrs• 7 years ago

Do you have any recommendations for building a custom language model for business-specific NER?

topicseed• 7 years ago

spaCy's updated Pattern Matcher is pretty amazing and we use it extensively in our textual content analyses to help SEOs.

mwexler• 7 years ago

MIT License for spaCy, though you'd never know it from the home page of the site. It is really frustrating to have such a nice tool with such a beautiful site, but have the site have no mention of the word "License" on it. Yes, it's in the code, but if one goes to the trouble to make such a great site, well...

danso• 7 years ago

spaCy's license has evolved over time. I know when its creator was discussing it on HN a few years ago, he had it under AGPL [0]:

This was my understanding --- actually I designed the licensing structure of this project around the assumption that companies would not want to use GPL licensed code commercially. I offer an AGPL license, and offer a commercial license for a fixed fee.

A couple years ago or so it went MIT, I think he might have mentioned it on HN at the time.

[0] https://news.ycombinator.com/item?id=8944705

ausjke• 7 years ago

sorry but why MIT license is bad here?

cwyers• 7 years ago

I don't think parent is complaining about the MIT license, they are complaining about how hard it is to find out what license is being used.

baconerrday• 7 years ago

I think he's just saying that it's a shame, because if people knew it was MIT licensed they would be more likely to use it.

ZeroCool2u2• 7 years ago

I can't recommend SpaCy enough. We use their Prodigy[1] app here at work, it's outstanding.

After experimenting with gensim, nltk, and most everything else under the sun, we primarily rely on SpaCy now with some TensorFlow for specific models.

1. https://prodi.gy/

syllogism2• 7 years ago

Glad to hear it! Actually we noticed the order come through for your group and felt it was a shame we didn't have a proper contact email. We're especially pleased to support public institutions like the FRB. I also did a little bit of consulting for the Bank of Canada. Could you email me? matt@explosion.ai

ZeroCool2u2• 7 years ago

Haha, hi Matt! Sure, just messaged you.

evrydayhustling• 7 years ago

spaCy in production for some grammar-based tokenization (frame.ai)! And their model for span annotations is awesome for our research pipeline; very convenient to be able to traverse pipeline objects in both directions to explore results.

wodenokoto• 7 years ago

How good is spaCy for exploratory analysis of a corpus?

I'm thinking, questions like, top adjectives applied to men and women, or top word usage across document classes.

The best I've come across for doing this easily is in R, where they have tidytext[1] which is nice, and very straight forward to understand and work with. However, the data model stores each token and all its meta data (page number, sentence number, document id / title, document class, word type, etc, etc) in its own row, causing the in memory size of whatever corpus you are working on to explode.

[1] https://www.tidytextmining.com

Advanced NLP with SpaCy

Related Stories