Scraping and indexing 1.2B emails for under $200

https://jordanpiepkow.com/scraping-and-indexing-1-2-billion-emails-for-under-200/

by jordiee • 6 years ago

30 6 6 years ago

slowhand09• 6 years ago

Nice writeup.

hbcondo714• 6 years ago

Wow, the author really calls out his competition! There are also parts 2 and 3 to this article that discusses using Rust and Postgres for their solution.

ad404b8a372f2b9• 6 years ago

Took me a while to understand they were scraping email addresses and not actual emails.

tdeck• 6 years ago

Is nobody going to mention how this is a bad thing intended for sending spam? Guess I'll have to be that person then.

thomas536• 6 years ago

I must be missing something because 6.5 days * $21/day = $136.5

"""

The entire process now took 6.5 days and cost $21/day. Our total cost all said and done was $115!

"""

natmaka• 6 years ago

Help rid the world of spam! Project Honey Pot is our friend. https://www.projecthoneypot.org/

Scraping and indexing 1.2B emails for under $200

Related Stories