DuckDuckBot
DuckDuckBot is assigned to the Search category by BotScope. Detection is based on the user-agent string. Current pattern:
DuckDuckBot
Search engine crawlers index publicly available content for their results. They typically fetch /robots.txt first and respect crawl-delay and Disallow rules. High crawl frequency usually correlates with good visibility in those search results.
Once DuckDuckBot shows up in your logs, BotScope lets you analyze its crawl paths, status codes, IP distribution and temporal activity — by hour, day or week.
robots.txt directive for DuckDuckBot
If you don't want DuckDuckBot to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: DuckDuckBot Disallow: /
This page is being enriched with detail knowledge about DuckDuckBot.