Adzuna
Adzuna is assigned to the Jobs category by BotScope. Detection is based on the user-agent string. Current pattern:
Adzunabot
Job aggregator crawlers fetch job postings for platforms like Indeed or StepStone. Crawl frequency grows with the number of your listings.
Once Adzuna shows up in your logs, BotScope lets you analyze its crawl paths, status codes, IP distribution and temporal activity — by hour, day or week.
robots.txt directive for Adzuna
If you don't want Adzuna to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: Adzunabot Disallow: /
This page is being enriched with detail knowledge about Adzuna.