Scrapingworld.com – Scraping Directory: components, providers, knowledge base

If you're going to start a directory, why wouldn't you do the research to seed it with elementary content? Your only info link is a wikipedia link about scraping and you're hoping people email you with more links.

Seems a bit bizarre to me.

kaltsturm7• 6 years ago

You are right - we just wanted to kickstart and will work on our own for sure to add more content. What are your top links with respect to scraping?

varenc• 6 years ago

Interesting collection of resources.

I found the residential IP proxy services a bit eyebrow raising. This one, https://luminati.io/ethical, apparently gets their residential IPs by having app developers embed the Luminati SDK. So when you use their proxy network, your request will be routed through some oblivious person’s phone or laptop. I assume that the requests can’t be end to end encrypted and that whatever user whose device is making the request will be able to see it.

While there’s certainly some legitimate and even noble uses of residential IP proxies, I can think of plenty nefarious ones too. Must be a constant challenge for this company to combat that. If they do.

kaltsturm7• 6 years ago

Thank you for sharing your insights - indeed. If residential proxies are needed for scraping, we shall keep your insights in mind.

bhargavdigi• 6 years ago

nice thanks for sharing us

kaltsturm7• 6 years ago

Do you know of any site-specific scraping services, e.g. eBay, Google, ... ?

Scrapingworld.com – Scraping Directory: components, providers, knowledge base

Related Stories