HN user

biosed

93 karma
Posts3
Comments32
View on HN

I used to lead Sys Eng for a FTSE 100 company. Our data was valuable but only for a short amount of time. We were constantly scraped which cost us in hosting etc. We even seen competitors use our figures (good ones used it to offset their prices, bad ones just used it straight). As the article suggest, we couldn't block mobile operator IPs, some had over 100k customers behind them. Forcing the users to login did little as the scrapers just created accounts. We had a few approaches that minimised the scraping:

Rate Limiting by login,

Limiting data to know workflows ...

But our most fruitful effort was when we removed limits and started giving "bad" data. By bad I mean alter the price up or down by a small percentage. This hit them in the pocket but again, wasn't a golden bullet. If the customer made a transaction on the altered figure we we informed them and took it at the correct price.

It's a cool problem to tackle but it is just an arms race.

Signed Char Lotte 5 years ago

You are correct but it happens in all fields/passions ...etc E.G. Jazz, you need to be a very good musician to create good jazz. A programmer could create something that creates jazz but jazz musicians will find it lacking, for want of a better word.

Got lost in a train of thought but I hope you understand what I'm trying to say.

Its the C9 and I have all the anti burnin features turned on, I have no issues, you can see the tv moving the whole screen a few pixels every so often.

I work for a FTSE 100 company and we recently completed a POC on GCP.

The sales guy was/is pushy but tbh the tech is very prescriptive on how things are done, it's the Google way or it doesn't work. That is not how enterprise works, you need to adapt to each customer.

We have lots of AWS and plan on using it more, we might be doing it sub optimally but it works.