Meta-ExternalAgent

Meta-ExternalAgent is assigned to the Social category by BotScope. Detection is based on the user-agent string. Current pattern:

meta-externalagent

Social media platforms index content for their internal search and for preview cards in posts. Unlike search engine crawlers they often limit themselves to URLs that were shared on their platform.

BotScope maps Meta-ExternalAgent requests onto your session timeline — you spot bursts, can filter them per path, and compare against other bots in the same category.

robots.txt directive for Meta-ExternalAgent

If you don't want Meta-ExternalAgent to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.

User-agent: meta-externalagent
Disallow: /

This page is being enriched with detail knowledge about Meta-ExternalAgent.

Similar crawlers in the same category

Discover more crawlers