StepStone
StepStone is assigned to the Jobs category by BotScope. Detection is based on the user-agent string. Current pattern:
StepStone
Job aggregator crawlers fetch job postings for platforms like Indeed or StepStone. Crawl frequency grows with the number of your listings.
In the BotScope dashboard you see for StepStone: top paths, status distribution, byte volume and whether the user-agent signature stays stable over time or rotates.
robots.txt directive for StepStone
If you don't want StepStone to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: StepStone Disallow: /
This page is being enriched with detail knowledge about StepStone.