YaDirectFetcher
AdvertisingVerify YaDirectFetcher IP Address
Verify if an IP address truly belongs to Yandex, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.
YaDirectFetcher is a Yandex crawler used to fetch landing pages and assets for advertising purposes within the Yandex.Direct ecosystem. It retrieves content to evaluate ad relevance, page availability, redirects, and compliance with advertising policies. This crawler supports both initial ad review and ongoing campaign monitoring. It is not a general search crawler and does not index content for Yandex Search. Blocking it may disrupt ad approval or delivery. Crawl activity is targeted and low-volume, typically triggered by ad creation, updates, or periodic quality checks across Yandex.Direct campaigns. It does not use the robots.txt at all and thus global robots.txt user agent (*) rule and its own directives are completely ignored. RobotSense.io verifies YaDirectFetcher using Yandex’s official validation methods, ensuring only genuine YaDirectFetcher traffic is identified.
User Agent Examples
Mozilla/5.0 (compatible; YaDirectFetcher/1.0; Dyatel; +http://yandex.com/bots)Robots.txt Configuration for YaDirectFetcher
YaDirectFetcherUse this identifier in your robots.txt User-agent directive to target YaDirectFetcher.
Recommended Configuration
Our recommended robots.txt configuration for YaDirectFetcher:
User-agent: YaDirectFetcher
Allow: /Completely Block YaDirectFetcher
Prevent this bot from crawling your entire site:
User-agent: YaDirectFetcher
Disallow: /Completely Allow YaDirectFetcher
Allow this bot to crawl your entire site:
User-agent: YaDirectFetcher
Allow: /Block Specific Paths
Block this bot from specific directories or pages:
User-agent: YaDirectFetcher
Disallow: /private/
Disallow: /admin/
Disallow: /api/Allow Only Specific Paths
Block everything but allow specific directories:
User-agent: YaDirectFetcher
Disallow: /
Allow: /public/
Allow: /blog/Set Crawl Delay
Limit how frequently YaDirectFetcher can request pages (in seconds):
User-agent: YaDirectFetcher
Allow: /
Crawl-delay: 10Note: This bot does not officially mention about honoring Crawl-Delay rule.