Ahrefs

Ahrefs is assigned to the SEO category by BotScope. Detection is based on the user-agent string. Current pattern:

AhrefsBot

SEO tool crawlers build internal databases for tools like Ahrefs, Semrush, Sistrix or Majestic. They have no direct SEO impact — only the tool accesses the data. Crawl frequency grows with your domain authority.

In the BotScope dashboard you see for Ahrefs: top paths, status distribution, byte volume and whether the user-agent signature stays stable over time or rotates.

robots.txt directive for Ahrefs

If you don't want Ahrefs to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.

User-agent: AhrefsBot
Disallow: /

This page is being enriched with detail knowledge about Ahrefs.

Similar crawlers in the same category

Discover more crawlers