My favorite thing was to identify bots and instead of blocking them, switch to a slightly scrambled data set to make the scrape useless but look good to the developer who stole it. It was a ton of fun as a side project. I'd also suggest you add some innocent fake data to your real site and then set up google alerts of all of the above to catch traffic. About 50% of sites would respond positively to an email when you showed them they were hosting fake data. About 90% would take my data down if that was followed up with a stronger C&D. One key is to catch them fast, while they're still a little nervous about showing off their stolen data online.
HN user
bmetz
16 karma
Posts0
Comments5
No posts found.
Ask HN: What do people use to prevent crawlers? 9 years ago
I'm gung-ho on solar but the article clearly says there is a low penalty for going over budget. They may just be guessing where prices will be by the time they have to pay for the panels.
Migrating From AWS to FB 12 years ago
And those "numerous integration points" are?
The new VirginAmerica.com 12 years ago
Still can't change my login email ID.
Interactive Resume 13 years ago
Tried to write him a note encouraging him to check us out. The comment box doesn't work. Designers, shrug. Seems like a pretty cool person!