Y

YandexSearchShop

Visit Bot Homepage

Verify YandexSearchShop IP Address

Verify if an IP address truly belongs to Yandex, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.

YandexSearchShop is a Yandex crawler used to download product catalogs provided in YML (Yandex Market Language) format at the request of users. These catalog files are typically used for shopping and comparison services and are often stored in directories that are otherwise prohibited from search indexing. The bot fetches only the specified YML files rather than crawling entire websites. This activity is not related to general search indexing. Crawl behavior is targeted and request-driven, focusing solely on retrieving product feeds needed to process user-submitted catalog data. It ignores the global robots.txt user agent (*) rule. RobotSense.io verifies YandexSearchShop using Yandex’s official validation methods, ensuring only genuine YandexSearchShop traffic is identified.

This bot does not honor Crawl-Delay rule.

User Agent Examples

Mozilla/5.0 (compatible; YandexSearchShop/1.0; +http://yandex.com/bots)
Example user agent strings for YandexSearchShop

Robots.txt Configuration for YandexSearchShop

Robots.txt User-Agent:YandexSearchShop

Use this identifier in your robots.txt User-agent directive to target YandexSearchShop.

Recommended Configuration

Our recommended robots.txt configuration for YandexSearchShop:

User-agent: YandexSearchShop
Allow: /

Completely Block YandexSearchShop

Prevent this bot from crawling your entire site:

User-agent: YandexSearchShop
Disallow: /

Completely Allow YandexSearchShop

Allow this bot to crawl your entire site:

User-agent: YandexSearchShop
Allow: /

Block Specific Paths

Block this bot from specific directories or pages:

User-agent: YandexSearchShop
Disallow: /private/
Disallow: /admin/
Disallow: /api/

Allow Only Specific Paths

Block everything but allow specific directories:

User-agent: YandexSearchShop
Disallow: /
Allow: /public/
Allow: /blog/

Set Crawl Delay

Limit how frequently YandexSearchShop can request pages (in seconds):

User-agent: YandexSearchShop
Allow: /
Crawl-delay: 10

Note: This bot does not officially mention about honoring Crawl-Delay rule.