Chrome Web Store / Google-CWS

Name: Chrome Web Store / Google-CWS
Author: Google

Developer Tools

Verify Chrome Web Store / Google-CWS IP Address

Verify if an IP address truly belongs to Google, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.

Chrome Web Store fetcher or Google-CWS is a Google user-agent associated with Chrome Web Services, typically used for link preview generation, safe browsing checks, and content fetching triggered by Chrome features. It performs lightweight requests to retrieve metadata, page titles, favicons, and safety signals from URLs that developers provide in the metadata of their Chrome extensions and themes. This bot is not a search crawler and does not influence Google Search indexing or rankings. Activity occurs when Chrome or Google services need to quickly inspect a URL for previews, safety evaluation, or rendering behavior. It ignores the global user agent (*) rule. RobotSense.io verifies Chrome Web Store fetcher using Google’s official validation methods, ensuring only genuine Chrome Web Store fetcher traffic is identified.

This bot does not honor Crawl-Delay rule.

User Agent Examples

Contains: Mozilla/5.0 (compatible; Google-CWS)

Robots.txt Configuration for Chrome Web Store / Google-CWS

Robots.txt User-Agent:Google-CWS

Use this identifier in your robots.txt User-agent directive to target Chrome Web Store / Google-CWS.

Recommended Configuration

Our recommended robots.txt configuration for Chrome Web Store / Google-CWS:

User-agent: Google-CWS
Allow: /

Completely Block Chrome Web Store / Google-CWS

Prevent this bot from crawling your entire site:

User-agent: Google-CWS
Disallow: /

Completely Allow Chrome Web Store / Google-CWS

Allow this bot to crawl your entire site:

User-agent: Google-CWS
Allow: /

Block Specific Paths

Block this bot from specific directories or pages:

User-agent: Google-CWS
Disallow: /private/
Disallow: /admin/
Disallow: /api/

Allow Only Specific Paths

Block everything but allow specific directories:

User-agent: Google-CWS
Disallow: /
Allow: /public/
Allow: /blog/

Set Crawl Delay

Limit how frequently Chrome Web Store / Google-CWS can request pages (in seconds):

User-agent: Google-CWS
Allow: /
Crawl-delay: 10

Note: This bot does not officially mention about honoring Crawl-Delay rule.