# Robots.txt for Groovy Social Media Auto-Poster # https://groovy-social-autoposter.com/robots.txt User-agent: * Allow: / Allow: /docs/api Allow: /auth/register Allow: /img/ Allow: /css/ Allow: /js/ # Disallow private/sensitive areas Disallow: /auth/login Disallow: /dashboard Disallow: /social/api-keys Disallow: /uploads/ Disallow: /admin/ Disallow: /api/ # Disallow common bot traps Disallow: /wp-admin/ Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /.git/ Disallow: /node_modules/ # Allow specific search engines User-agent: Googlebot Allow: / Allow: /docs/api User-agent: Bingbot Allow: / Allow: /docs/api User-agent: Slurp Allow: / Allow: /docs/api # Crawl delay for general bots Crawl-delay: 1 # Sitemap location Sitemap: https://groovy-social-autoposter.com/sitemap.xml