D

Dotbot

Operated by MozSEO Tools
Visit Bot Homepage

Verify Dotbot IP Address

Verify if an IP address truly belongs to Moz, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.

Dotbot is the web crawler operated by Moz, primarily used to build and maintain Moz’s link index and web graph. It crawls webpages to discover backlinks, anchor text, page relationships, and structural signals used in Moz’s SEO and link intelligence products. Dotbot is not a public search engine crawler and does not influence search rankings directly. Crawl activity can be moderate to high depending on site size and connectivity, reflecting its role in mapping link relationships across the web for SEO analysis and competitive research. RobotSense.io verifies dotbot using Moz's official validation methods, ensuring only genuine dotbot traffic is identified.

This bot officially honors Crawl-Delay rule.

User Agent Examples

Contains: dotbot
Example user agent strings for Dotbot

Robots.txt Configuration for Dotbot

Robots.txt User-Agent:dotbot

Use this identifier in your robots.txt User-agent directive to target Dotbot.

Recommended Configuration

Our recommended robots.txt configuration for Dotbot:

User-agent: dotbot
Allow: /

Completely Block Dotbot

Prevent this bot from crawling your entire site:

User-agent: dotbot
Disallow: /

Completely Allow Dotbot

Allow this bot to crawl your entire site:

User-agent: dotbot
Allow: /

Block Specific Paths

Block this bot from specific directories or pages:

User-agent: dotbot
Disallow: /private/
Disallow: /admin/
Disallow: /api/

Allow Only Specific Paths

Block everything but allow specific directories:

User-agent: dotbot
Disallow: /
Allow: /public/
Allow: /blog/

Set Crawl Delay

Limit how frequently Dotbot can request pages (in seconds):

User-agent: dotbot
Allow: /
Crawl-delay: 10

Note: This bot officially honors the Crawl-delay directive.