# ADN corpus crawler | Agent Delivery Network

<!-- adn:geo-lead -->
> Identification and allowlisting for the Agent Delivery Network ingest crawler (ADN-Corpus).

<!-- /adn:geo-lead -->

Bot information
# ADN ingest crawler
 ADN fetches publisher HTML to build Markdown and structured agent content. Corpus origin fetches identify themselves with HTTP Message Signatures (Web Bot Auth), an optional per-domain header, and the User-Agent below.
## User-Agent
 ADN-Corpus/1.1 (+https://agent-delivery.network/bot)
## Per-domain allow header
 Customers rotate a secret in the dashboard. Publishers can allowlist x-adn-crawler-token in firewall rules.
## Web Bot Auth directory
 Public Ed25519 keys for verifying RFC 9421 signatures on ADN corpus traffic.
 https://agent-delivery.network/.well-known/http-message-signatures-directory
## IP ranges (last resort)
 ADN ingest runs on Cloudflare Workers. Egress IPs are shared with other Cloudflare customers. Prefer token or signature allowlists over IP alone.
 https://www.cloudflare.com/ips-v4/
 Canonical URL for this page: https://agent-delivery.network/bot
 Ask ADN