AI Crawler Blocking in Top Websites
AI Crawler Blocking in Top Websites
- GPTBot
- ClaudeBot
- CCBot
- PerplexityBot
- Google-Extended
- Bytespider
- Observed cohort coverage
AI data
Web Ecosystem
How AI crawlers and agents interact with publishers and the open web.
Open Web
AI Crawler Traffic Share by Operator
AI Crawler Traffic Share by Operator
- Meta
- Anthropic
- OpenAI
- Amazon
- Huawei
- Other