NamedTest

AI crawler checker

Enter your website to see whether its robots.txt file lets the AI crawlers in. If OAI-SearchBot or PerplexityBot is blocked, ChatGPT search and Perplexity cannot read your pages, so they are less likely to name you.

Free, no account. We read only your robots.txt and keep nothing about the site you check.

The six crawlers we check

  • GPTBot (OpenAI): Collects pages for training OpenAI's models. Source
  • OAI-SearchBot (OpenAI): Finds pages to show in ChatGPT search answers. Source
  • ChatGPT-User (OpenAI): Visits a page when a ChatGPT user asks about it. OpenAI says robots.txt rules may not apply to these visits. Source
  • PerplexityBot (Perplexity): Finds and links pages in Perplexity's answers. Source
  • ClaudeBot (Anthropic): Collects pages for Anthropic's models. Source
  • Google-Extended (Google): Controls whether Google may use your pages for Gemini. It does not affect Google Search. Source

Descriptions checked on October 15, 2026 against each company's page.

How to fix a blocked crawler

Open your robots.txt (at yoursite.com/robots.txt) and look for a User-agent line naming the crawler, or User-agent: *, followed by Disallow: /. Remove that rule or add anAllow: / group for the crawler. On WordPress and site builders, the rule often comes from an SEO or security plugin setting. You can block GPTBot and ClaudeBot from training and still allow OAI-SearchBot and PerplexityBot, which find pages for answers.

The main guide covers the other six things that decide whether AI names you.

Does AI name your business?

The free check asks Perplexity and Google AI five questions a customer in your city would ask about your trade, and shows who they name. It takes about a minute.

Run the free check