Ask HN: Web-scraping – Do patterns/recipes exist for common scraping targets?

https://news.ycombinator.com/item?id=24440466
by kisamoto • 6 years ago
10 7 6 years ago

I'm fairly familiar with web scraping/crawling however I was wondering if there is a company/tool that has re-usable modules for scraping common websites?

Examples could include: scraping article texts from news websites; extracting recipes from Good Food etc.

Rather than rewriting what others have - is there an existing library of these scrapers/crawlers to use 'out of the box'?

Related Stories

Loading related stories...

Source preview

news.ycombinator.com