Block GPTBot: free robots.txt checker
See whether GPTBot can crawl your site right now and get a copy-paste robots.txt rule to block it. No install, results in two minutes.
GPTBot is OpenAI's training crawler. By default, it can fetch any public URL on your site unless your robots.txt explicitly disallows it. Adding a one-line rule blocks it across your entire domain.
The free checker on this page reads your live robots.txt, lists every AI bot's status (allowed, denied, or unspecified), and gives you a copy-paste snippet for the bots you want to block. It runs against 33+ named AI crawlers, not just GPTBot, so you can audit your full posture in one pass.
Frequently asked questions
- How do I block GPTBot in robots.txt? +
- Add User-agent: GPTBot then Disallow: / on the next line. Save robots.txt at the root of your domain. The free checker above generates this snippet for you and shows your current allowed or denied state.
- Does blocking GPTBot also block ChatGPT users? +
- No. GPTBot is OpenAI's training crawler. ChatGPT-User is a separate token used when a person asks ChatGPT to fetch a specific URL on their behalf. Block one, the other still works.
- How long until robots.txt changes take effect? +
- GPTBot re-checks robots.txt frequently for sites it has crawled before. Most changes are honored within a few days. Sites with low crawl volume can take a week or two.
- What if my CMS already manages robots.txt? +
- Most platforms (WordPress, Webflow, Shopify) let you override or append rules through a settings panel or theme file. The checker above flags what is currently served at /robots.txt regardless of how it was generated.
How It Works
Enter your domain
We fetch your public robots.txt — no install, no auth, no site changes.
Diff against AI bot registry
Your rules are checked against 33+ AI crawlers and agents (OpenAI, Anthropic, Perplexity, Google, Meta, ...).
Get a strategic report
Per-bot status, posture flags, and downloadable robots.txt presets you can copy-paste.