AhrefsSiteAudit

AhrefsSiteAudit is assigned to the SEO category by BotScope. Detection is based on the user-agent string. Current pattern:

AhrefsSiteAudit

SEO tool crawlers build internal databases for tools like Ahrefs, Semrush, Sistrix or Majestic. They have no direct SEO impact — only the tool accesses the data. Crawl frequency grows with your domain authority.

In the BotScope dashboard you see for AhrefsSiteAudit: top paths, status distribution, byte volume and whether the user-agent signature stays stable over time or rotates.

robots.txt directive for AhrefsSiteAudit

If you don't want AhrefsSiteAudit to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.

User-agent: AhrefsSiteAudit
Disallow: /

This page is being enriched with detail knowledge about AhrefsSiteAudit.

🟢Active crawlerlast seen 2 days ago · 2026-05-25
Popular crawlers by category
SearchGooglebot-ImageGooglebot-VideoGooglebot-News
AI CrawlersGoogle-ExtendedGoogle-NotebookLMGoogle-Lens
User BotsChatGPT-UserClaude-UserPerplexity-User
Link PreviewGoogleImageProxyChrome Privacy Preserving Prefetch ProxyGoogle Web Preview
AppsSlack-AppClaude-AppGrok-App
Social MediaFacebookTwitterbotLinkedInBot
MonitoringBotScopeGoogle-FirebaseUptimeRobot
SecurityGoogle-SafetyGoogle-Site-VerificationVisionHeight
AdvertisingAdsBot-GoogleMediapartners-GoogleGoogle-Display-Ads-Bot
Price Comparisonbilliger.deidealoGeizhals
PaymentStripeMolliePayPal
LegalComplianceCheckerCookiebotCookieYes
JobsLinkupBotIndeedJooble
OfficeGoogle DocsMicrosoft OfficeLibreOfficeApache OpenOffice
PlagiarismTurnitinCopyleaksCopyscape
ScrapersGoogle-Read-AloudFeedfetcherGoogle-Apps-Script
Plugin/CMSJetpackCleantalkWordPress.com

Similar crawlers in the same category

Schema-Markup-ValidatorSEO Google-Structured-DataSEO AhrefsSEO SemrushSEO SiteAuditBotSEO SplitSignalBotSEO

Discover more crawlers

TurnitinBotAIRoku-AppApps7SitersScraperBloonixMonitorPaperLiBotSearchEchoboxBotScraper