# robots.txt for freebatteryfactory.com # # Posture: open. We WANT search engines and AI assistants to read the site, # the public profile, and the agent brief — discoverability is the point. # NOTE: if AI bots are still blocked in production, the cause is Cloudflare's # Managed robots.txt / "Block AI bots" setting, which is injected ahead of this # file at the edge. Turn that off in the Cloudflare dashboard (AI Crawl Control) # so these rules are the ones actually served. User-agent: * # Content Signals Policy (cloudflare.com/content-signals-policy): machine-readable # opt-IN. We WANT to be searched, cited by AI answers, and trained on — so all # three are `yes` (this overrides Cloudflare Managed-robots.txt's ai-train=no # default, if that ever gets injected ahead of this file). Content-Signal: search=yes, ai-train=yes, ai-input=yes Allow: / # Search + AI assistants — explicit allows (read / retrieval / RAG) User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Google-Extended Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot Allow: / User-agent: Applebot Allow: / # Sitemap Sitemap: https://freebatteryfactory.com/sitemap-index.xml