Google-CloudVertexBot
AI AgentVerify Google-CloudVertexBot IP Address
Verify if an IP address truly belongs to Google, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.
Google-CloudVertexBot is a crawler associated with Google Cloud’s Vertex AI ecosystem, used to retrieve web content for AI model evaluation, dataset preparation, and automated tool workflows within Vertex pipelines. The bot’s crawling is typically task-specific-triggered by developers using Vertex AI services that require fetching external URLs for analysis or model inputs. Overall activity is low to moderate, aligned with customer workloads rather than large-scale search indexing. RobotSense verifies Google-CloudVertexBot using Google’s official validation methods, ensuring only genuine Google-CloudVertexBot traffic is identified.
User Agent Examples
Contains: Google-CloudVertexBotRobots.txt Configuration for Google-CloudVertexBot
Google-CloudVertexBotUse this identifier in your robots.txt User-agent directive to target Google-CloudVertexBot.
Recommended Configuration
Our recommended robots.txt configuration for Google-CloudVertexBot:
User-agent: Google-CloudVertexBot
Allow: /Completely Block Google-CloudVertexBot
Prevent this bot from crawling your entire site:
User-agent: Google-CloudVertexBot
Disallow: /Completely Allow Google-CloudVertexBot
Allow this bot to crawl your entire site:
User-agent: Google-CloudVertexBot
Allow: /Block Specific Paths
Block this bot from specific directories or pages:
User-agent: Google-CloudVertexBot
Disallow: /private/
Disallow: /admin/
Disallow: /api/Allow Only Specific Paths
Block everything but allow specific directories:
User-agent: Google-CloudVertexBot
Disallow: /
Allow: /public/
Allow: /blog/Set Crawl Delay
Limit how frequently Google-CloudVertexBot can request pages (in seconds):
User-agent: Google-CloudVertexBot
Allow: /
Crawl-delay: 10Note: This bot does not officially mention about honoring Crawl-Delay rule.