Meta-ExternalFetcher
Meta-ExternalFetcher is assigned to the User-Bot category by BotScope. Detection is based on the user-agent string. Current pattern:
meta-externalfetcher
User-initiated AI bots are triggered when a real human asks the AI assistant a question and the system fetches your page live to generate the answer. Each hit is a signal: your content is right now being used in an AI answer.
BotScope aggregates every Meta-ExternalFetcher request in your session: which URLs it prefers, how many 4xx/5xx responses it gets, whether it crawls from one or many IPs, and what time window it's particularly active in.
robots.txt directive for Meta-ExternalFetcher
If you don't want Meta-ExternalFetcher to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: meta-externalfetcher Disallow: /
This page is being enriched with detail knowledge about Meta-ExternalFetcher.