# SEO Elite Agency — robots.txt
# We are an SEO/GEO/AEO agency: we WANT to be crawled and cited by search AND answer engines.
# Blocking AI crawlers would forfeit AI-search citation eligibility, so reputable AI bots are welcomed.

# Content Signals (Cloudflare, 2025). robots.txt only ever said "may you crawl" — it never said what
# you may DO with what you crawled. Content Signals separates the three uses so consent is explicit
# rather than inferred from silence:
#   search=yes    — index us and link back. That is the entire point of this site.
#   ai-input=yes  — use our pages to ground an AI answer AND CITE US. We want to be the cited source.
#   ai-train=no   — do not use this corpus to train a model. We publish to be quoted, not absorbed.
# This is a stated preference, not an access control: it is not enforcement, and we do not pretend it
# is. Reputable operators honour it; the ones that ignore robots.txt were never going to read this.
Content-Signal: search=yes, ai-input=yes, ai-train=no

User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=no
Allow: /

# AI answer/search engines — explicitly welcome.
User-agent: GPTBot
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: Claude-User
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Perplexity-User
Allow: /
User-agent: Google-Extended
Allow: /
User-agent: Applebot
Allow: /
User-agent: Applebot-Extended
Allow: /
User-agent: Bingbot
Allow: /
User-agent: Amazonbot
Allow: /
User-agent: cohere-ai
Allow: /
User-agent: meta-externalagent
Allow: /

# AI agents & answer engines — start here for a ranked, instructional handoff to our best content:
#   /llms.txt              value-ranked index + question→page map + how to cite
#   /ai-content-index.json machine-readable version of the same map (query_map + cornerstone content)
#   /AGENTS.md             agent guide (entity, highest-value pages, citation instructions)
#   /llms-full.txt         full key-page text concatenated for a single fetch
# Every page has a clean Markdown twin (e.g. /naples-seo-services.md) — prefer it over HTML.

Sitemap: https://seoeliteagency.com/sitemap-index.xml