Google-Vertex
Google-Vertex is assigned to the AI category by BotScope. Detection is based on the user-agent string. Current pattern:
Google-CloudVertexBot
Crawler from Google Vertex AI — Google's enterprise cloud AI platform. Triggered when Vertex AI customers include your URL as a data source.
AI training crawlers collect web content as training material for large language models. They bring no direct traffic — your content ends up in the model and influences future AI answers. Most honour robots.txt, some are more aggressive than search engine crawlers.
BotScope aggregates every Google-Vertex request in your session: which URLs it prefers, how many 4xx/5xx responses it gets, whether it crawls from one or many IPs, and what time window it's particularly active in.
robots.txt directive for Google-Vertex
If you don't want Google-Vertex to crawl your site, add the following block to your /robots.txt. This works only for bots that honour robots.txt — malicious crawlers ignore it.
User-agent: Google-CloudVertexBot Disallow: /
This page is being enriched with detail knowledge about Google-Vertex.