GPTBot
GPTBot is assigned to the AI category by BotScope. Detection is based on the user-agent string. Current pattern:
GPTBot
AI training crawlers collect web content as training material for large language models. They bring no direct traffic — your content ends up in the model and influences future AI answers. Most honour robots.txt, some are more aggressive than search engine crawlers.
BotScope aggregates every GPTBot request in your session: which URLs it prefers, how many 4xx/5xx responses it gets, whether it crawls from one or many IPs, and what time window it's particularly active in.
robots.txt directive for GPTBot
If you don't want GPTBot to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: GPTBot Disallow: /
This page is being enriched with detail knowledge about GPTBot.