O

OAI-SearchBot

Visit Bot Homepage

Verify OAI-SearchBot IP Address

Verify if an IP address truly belongs to OpenAI, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.

OAI-SearchBot is a search bot operated by OpenAI. Data collected from the bot is used to link to and surface websites in search results in ChatGPT's search features. As per OpenAI, it is not used to crawl content to train its generative AI foundation models. OpenAI recommends allowing OAI-SearchBot in your site’s robots.txt file to help ensure that your site appears in search results. RobotSense.io verifies OpenAI OAI-SearchBot using OpenAI’s official validation methods, ensuring only genuine OAI-SearchBot traffic is identified.

This bot does not honor Crawl-Delay rule.

User Agent Examples

Full user-agent string will contain ; OAI-SearchBot/1.0; +https://openai.com/searchbot
Example user agent strings for OAI-SearchBot

Robots.txt Configuration for OAI-SearchBot

Robots.txt User-Agent:OAI-SearchBot

Use this identifier in your robots.txt User-agent directive to target OAI-SearchBot.

Recommended Configuration

Our recommended robots.txt configuration for OAI-SearchBot:

User-agent: OAI-SearchBot
Allow: /

Completely Block OAI-SearchBot

Prevent this bot from crawling your entire site:

User-agent: OAI-SearchBot
Disallow: /

Completely Allow OAI-SearchBot

Allow this bot to crawl your entire site:

User-agent: OAI-SearchBot
Allow: /

Block Specific Paths

Block this bot from specific directories or pages:

User-agent: OAI-SearchBot
Disallow: /private/
Disallow: /admin/
Disallow: /api/

Allow Only Specific Paths

Block everything but allow specific directories:

User-agent: OAI-SearchBot
Disallow: /
Allow: /public/
Allow: /blog/

Set Crawl Delay

Limit how frequently OAI-SearchBot can request pages (in seconds):

User-agent: OAI-SearchBot
Allow: /
Crawl-delay: 10

Note: This bot does not officially mention about honoring Crawl-Delay rule.