Ask HN: Legally Scraping Reddit Images

https://news.ycombinator.com/item?id=22428591
by djaque • 6 years ago
3 1 6 years ago

I'm considering working on a project related to GANs and started to research where I could get training data for it. I came across a subreddit full of community-filtered images of exactly what I need. There's also roughly 100K of them which is exactly how many I was hoping for.

The only problem is that I don't have any experience with collecting that magnitude of data. Does anyone have experience with scraping reddit and can offer pointers on how to approach it? I'm also having a difficult time figuring out if reddit even allows this.

Related Stories

Loading related stories...

Source preview

news.ycombinator.com