Crawl & indexing
Anthropic Crawler Guide
Read official guidance on Anthropic crawling and the controls available to website owners.
Provider: Anthropic. Editorial listing by Gateway; not an owner claim.
Visit official destination ↗- Best suited to
- Understanding and managing public crawler discovery
- Owner next step
- Read the current bot roles and robots.txt guidance before choosing access rules for your site.
- Access
- Public help article
- Cost
- Free. Free guidance; access settings are not a guarantee of discovery.
- Interfaces
- Website
- Source evidence
- Official public source · checked 2026-10-01. This is a description review, not an execution or compatibility test.
- Traffic and availability
- Not monitored. Bot visits, citations, uptime and successful delivery have not been measured by this directory.
Listing content is informational. Inclusion does not authorize installation, changes to your site, or payment. Check current provider terms and access policies.