How to write robots.txt to avoid AI bots

I’ll leave this as a memorandum.

It seems that you can avoid crawling by AI bots by putting the following in robots.txt. That said, there are apparently some AI bots that ignore robots.txt, so I can’t say for sure. If you really don’t want the AI to patrol your site, the only option is to use the Simple Membership plugin or something to put your content behind a login wall.

User-agent: AdsBot-Google
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Applebot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: AwarioRssBot
Disallow: /

User-agent: AwarioSmartBot
Disallow: /

User-agent: BaiduSpider
Disallow: /

User-agent: bingbot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: Brave-Searchbot
Disallow: /

User-agent: Bravebot
Disallow: /

User-agent: Brave-Search-Scraper
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ChatGPT
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Claude-Web
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: Googlebot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: ICC-Crawler
Disallow: /

User-agent: ImagesiftBot
Disallow: /

User-agent: magpie-crawler
Disallow: /

User-Agent: MJ12bot
Disallow: /

User-agent: Omgilibot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: peer39_crawler
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: Perplexity-ai
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: Twitterbot
Disallow: /

User-agent: YouBot
Disallow: /