User-agent: Mediapartners-Google* Crawl-delay: 10 # 1/15/2023 TCH: This bot was bringing down the server: User-agent: serpstatbot Disallow: / # AI Bots Crawl Delay User-agent: GPTBot Crawl-delay: 10 User-agent: ChatGPT-User Crawl-delay: 10 User-agent: CCBot Crawl-delay: 10 User-agent: ClaudeBot Crawl-delay: 10 User-agent: Google-Extended Crawl-delay: 10