Glassdoor
Glassdoor is assigned to the Jobs category by BotScope. Detection is based on the user-agent string. Current pattern:
Glassdoor
Job aggregator crawlers fetch job postings for platforms like Indeed or StepStone. Crawl frequency grows with the number of your listings.
BotScope maps Glassdoor requests onto your session timeline — you spot bursts, can filter them per path, and compare against other bots in the same category.
robots.txt directive for Glassdoor
If you don't want Glassdoor to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: Glassdoor Disallow: /
This page is being enriched with detail knowledge about Glassdoor.