Block Common Crawl via robots.txt
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
00
·30 active installs·Updated 2 years agoAs of April 2026, Block Common Crawl via robots.txt is a WordPress bot plugin with 30 active installations and a 0/5 rating0. It has been downloaded 1.0K+ times in total. Requires WordPress 5.9+ and PHP 7.4+. Available on WordPress.org since 2023. Last updated 2 years ago — may have compatibility concerns. Top alternative: Chatbot for WordPress by Collect.chat ⚡️.
0/5Rating
30active installs
1.0K+total downloads
3 yearssince 2023
Overview
This plugin adds lines to the virtual robots.txt file that WordPress creates automagically if the file is not present physically on the server to block the Common Crawl bot (CCBot) that is used to train AI algorithms like ChatGPT (in version 3.5 it makes up 60% of the training data mix) to crawl websites. Here is the information about the Common Crawl bot (CCBot).
Please be aware of what this plugin does exactly: If you activate the plugin it will add some lines to the robots.txt file to tell Common Crawl bots to not to crawl and index parts of this website.
Please only activate this plugin if you know what you’re doing.
What can I do with this plugin?
This plugin adds the necessary lines to the virtual robots.txt file that WordPress creates automagically to block the Common Crawl…
Screenshots
Ratings & Reviews
00 reviews
5 ★
0
4 ★
0
3 ★
0
2 ★
0
1 ★
0
Compatibility
| WordPress | 5.9+ requiredTested up to 6.3.8 |
| PHP | 7.4+ required |
Top Alternatives to Block Common Crawl via robots.txt
Frequently Asked Questions
Changelog
1.0.0 (21/APR/2023)
- First release.
Contributors
Plugin data sourced from WordPress.org. Analysis and metrics by PluginSift.