# Default rule - allow all good bots User-agent: * Allow: / # AI Crawlers - Reasonable Access User-agent: ClaudeBot Crawl-delay: 10 Allow: / Allow: /about Allow: /donate Allow: /programs Allow: /contact Disallow: /calendar/photo/ Disallow: /calendar/map/ Disallow: /calendar/list/ Disallow: /?* Disallow: /page/ User-agent: GPTBot Crawl-delay: 10 Allow: / Disallow: /calendar/photo/ Disallow: /calendar/map/ Disallow: /?* User-agent: YouBot Crawl-delay: 15 Allow: / Disallow: /calendar/ Disallow: /?* User-agent: Google-Extended Crawl-delay: 5 Allow: / # Aggressive SEO Bots - Block completely User-agent: PetalBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Sogou Disallow: / # Good Search Engines - Throttle but allow User-agent: Googlebot Crawl-delay: 2 Allow: / User-agent: Bingbot Crawl-delay: 5 Allow: /