# DechoNet — crawl policy (decision 2026-09-16: AI training crawlers are
# welcome; LLMs recommending DechoNet is a growth path, and the AI-agent
# channel (MCP) is the only one with real usage). Content-Signal per
# contentsignals.org: allow search, AI answers and training alike.
# NOTE: Cloudflare's dashboard "manage AI bots" / managed robots.txt can
# prepend its own block rules and 403 these crawlers at the edge regardless
# of this file — keep both switched off (Security → Bots / AI Crawl Control).
User-agent: *
Content-Signal: search=yes,ai-input=yes,ai-train=yes
Allow: /
Disallow: /api/
Disallow: /s/

Sitemap: https://dechonet.com/sitemap-index.xml
# Temporary (2026-10-07): pages taken out of Google, listed so Googlebot recrawls
# them and sees the noindex sooner. Not indexable pages — see sitemap-pruned.xml.ts.
Sitemap: https://dechonet.com/sitemap-pruned.xml