# Allow all well-behaved crawlers User-agent: * Allow: / # Sitemap Sitemap: https://www.primelocalgrowth.com/sitemap.xml # Block unwanted AI scrapers User-agent: ChatGPT-User Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: OAI-SearchBot Disallow: / # Optional: Protect non-public areas (uncomment if used) # Disallow: /admin/ # Disallow: /private/ # Disallow: /tmp/