# Ingest, crawl status, and common errors - Agent Delivery Network | Agent Delivery Network

<!-- adn:geo-lead -->
> Understand ingest progress, origin blocks, JS renders, crawl pricing probes, and how to fix frequent dashboard errors.

<!-- /adn:geo-lead -->

Back to Help Ingest builds your Markdown catalog and discovery files from origin HTML. Gateway traffic is separate: live agent requests you see in Analytics.
## Healthy ingest
 • Domains → Content (or Discovery files) shows generated previews after pages are indexed.
 • Origin access → Test fetch returns success.
 • No persistent block banner on Origin access.
## Common problems and fixes
 Symptom Likely cause What to do
 Test fetch fails with 403/401 Firewall, bot fight, or missing allow rule Follow Origin access ; allow Web Bot Auth, token header, and User-Agent
 Empty discovery preview Ingest not run yet Wait for nightly catalog pass or trigger ingest from the dashboard
 "Discovery file not built yet" Page not indexed Index the path or run ingest
 "Ingest queued a render but snapshot not ready" JS render queue busy Retry preview; check JS render quota in Settings
 Pay-per-crawl never returns 402 Upstream edge blocks GPTBot before ADN See Allow AI crawlers through
 Thin static HTML on SPAs Legitimate JS render ADN renders only when static HTML is thin and content changed (see Billing and usage )
## Crawl pricing and status
 When crawl billing is enabled on a domain:
 • Named AI crawlers should receive HTTP 402 on priced paths once they reach ADN ( x-adn-outcome headers present).
 • Crawl transactions in the dashboard list charges, discounts for registered agents, and payout status.
 • Edge block diagnostics may set crawl_ai_edge_block_* fields when probes detect a block before ADN.
## JS render queue
 Headless renders are used sparingly for thin SPAs. They count against your monthly JS page render allowance with gateway live renders (see billing guide). If the allowance is exhausted with overages off, new renders stop at the hard cap until the next UTC month.
## Related
 • Origin access and crawler allowlisting
 • Billing and usage
 • Troubleshooting FAQ
 Ask ADN