/ 14 min read / Servers and Hosting
Letting Verified AI Crawlers Through the Nginx Bad Bot Blocker
A User-Agent whitelist is not enough to let ClaudeBot or GPTBot through the Nginx Bad Bot Blocker once AbuseIPDB is involved. Here is how to verify AI crawlers against their published IP ranges instead.