OAI-SearchBot
SearchVerify OAI-SearchBot IP Address
Verify if an IP address truly belongs to OpenAI, using official verification methods. Enter both IP address and User-Agent from your logs for the most accurate bot verification.
OAI-SearchBot is a search bot operated by OpenAI. Data collected from the bot is used to link to and surface websites in search results in ChatGPT's search features. As per OpenAI, it is not used to crawl content to train its generative AI foundation models. OpenAI recommends allowing OAI-SearchBot in your site’s robots.txt file to help ensure that your site appears in search results. RobotSense.io verifies OpenAI OAI-SearchBot using OpenAI’s official validation methods, ensuring only genuine OAI-SearchBot traffic is identified.
User Agent Examples
Full user-agent string will contain ; OAI-SearchBot/1.0; +https://openai.com/searchbotRobots.txt Configuration for OAI-SearchBot
OAI-SearchBotUse this identifier in your robots.txt User-agent directive to target OAI-SearchBot.
Recommended Configuration
Our recommended robots.txt configuration for OAI-SearchBot:
User-agent: OAI-SearchBot
Allow: /Completely Block OAI-SearchBot
Prevent this bot from crawling your entire site:
User-agent: OAI-SearchBot
Disallow: /Completely Allow OAI-SearchBot
Allow this bot to crawl your entire site:
User-agent: OAI-SearchBot
Allow: /Block Specific Paths
Block this bot from specific directories or pages:
User-agent: OAI-SearchBot
Disallow: /private/
Disallow: /admin/
Disallow: /api/Allow Only Specific Paths
Block everything but allow specific directories:
User-agent: OAI-SearchBot
Disallow: /
Allow: /public/
Allow: /blog/Set Crawl Delay
Limit how frequently OAI-SearchBot can request pages (in seconds):
User-agent: OAI-SearchBot
Allow: /
Crawl-delay: 10Note: This bot does not officially mention about honoring Crawl-Delay rule.