# Robots.txt for Active Development # Allow all bots User-agent: * Allow: / # Disallow admin or private paths (if any exist) # Disallow: /admin/ # Disallow: /api/ # Sitemap location Sitemap: https://activedevelopment.co.nz/sitemap.xml # Crawl delay (optional - uncomment if needed) # Crawl-delay: 1