Googlebot-News
Googlebot-News is assigned to the Search category by BotScope. Detection is based on the user-agent string. Current pattern:
Googlebot-News
Crawler for Google News. High requirements on freshness, clear publication dates, NewsArticle schema and quick publication speed. News content is usually crawled within minutes.
Search engine crawlers index publicly available content for their results. They typically fetch /robots.txt first and respect crawl-delay and Disallow rules. High crawl frequency usually correlates with good visibility in those search results.
BotScope aggregates every Googlebot-News request in your session: which URLs it prefers, how many 4xx/5xx responses it gets, whether it crawls from one or many IPs, and what time window it's particularly active in.
robots.txt directive for Googlebot-News
If you don't want Googlebot-News to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: Googlebot-News Disallow: /
This page is being enriched with detail knowledge about Googlebot-News.