Show HN: AI / LLM bot blocker web server configs

https://github.com/anthmn/ai-bot-blocker
by anthonyhn • 2 years ago
2 0 2 years ago

Hello HN. I recently released the source code for a set of AI / LLM bot blocker web server configs that are used by my search engine (Ichido Search [0]) to block AI bots from crawling the pages. Sharing here, as others may have use cases for these configs as well. Supports the following web servers:

* Apache (and .htaccess) * Nginx * Lighttpd * Caddy * IIS (untested)

[0] https://ichi.do/

Related Stories

Loading related stories...

Source preview

github.com