Show HN: I made a tool to download all of Wikipedia on a weekly basis

https://github.com/ternera/auto-wikipedia-download
by ternera • 1 year ago
2 0 1 year ago

Hi everyone. This tool exists as a way to quickly and easily download all of Wikipedia (as a .bz2 archive) from the Wikimedia data dumps, but it also prompts users to automate the process by downloading an updated version and replacing the old download every week. I plan to throw this on a Linux server and thought it may come in useful for others!

Inspiration came from the following comment on Reddit, which asked about automating the process:

https://www.reddit.com/r/YouShouldKnow/comments/whxmhc/comme...

Related Stories

Loading related stories...

Source preview

github.com