YandexWebmaster

Name: YandexWebmaster
Author: Yandex

Others

Verify YandexWebmaster IP Address

Verify if an IP address truly belongs to Yandex, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.

YandexWebmaster is a Yandex crawler used in connection with Yandex Webmaster tools to perform site diagnostics, verification, and technical checks. It fetches webpages when site owners use Webmaster features such as URL inspection, indexing checks, error analysis, or configuration validation. This traffic is on-demand and user-initiated, not part of broad search crawling or discovery. Crawl activity is typically low-volume and focused on specific URLs submitted through Webmaster tools to help site owners monitor and optimize their sites for Yandex Search. It honors the global robots.txt user agent (*) rule. RobotSense.io verifies YandexWebmaster using Yandex’s official validation methods, ensuring only genuine YandexWebmaster traffic is identified.

This bot does not honor Crawl-Delay rule.

User Agent Examples

Mozilla/5.0 (compatible; YandexWebmaster/2.0; +http://yandex.com/bots)

Robots.txt Configuration for YandexWebmaster

Robots.txt User-Agent:YandexWebmaster

Use this identifier in your robots.txt User-agent directive to target YandexWebmaster.

Recommended Configuration

Our recommended robots.txt configuration for YandexWebmaster:

User-agent: YandexWebmaster
Allow: /

Completely Block YandexWebmaster

Prevent this bot from crawling your entire site:

User-agent: YandexWebmaster
Disallow: /

Completely Allow YandexWebmaster

Allow this bot to crawl your entire site:

User-agent: YandexWebmaster
Allow: /

Block Specific Paths

Block this bot from specific directories or pages:

User-agent: YandexWebmaster
Disallow: /private/
Disallow: /admin/
Disallow: /api/

Allow Only Specific Paths

Block everything but allow specific directories:

User-agent: YandexWebmaster
Disallow: /
Allow: /public/
Allow: /blog/

Set Crawl Delay

Limit how frequently YandexWebmaster can request pages (in seconds):

User-agent: YandexWebmaster
Allow: /
Crawl-delay: 10

Note: This bot does not officially mention about honoring Crawl-Delay rule.