AI Search Visibility · AuditJet Glossary
GPTBot
OpenAI's web crawler used to collect training data and power ChatGPT's web search capabilities.
GPTBot is OpenAI's crawler with User-agent 'GPTBot'. Websites can allow or block GPTBot via robots.txt. Blocking GPTBot prevents a site from being used in ChatGPT's responses and training data. As ChatGPT's web browsing and search features expand, GPTBot access is becoming increasingly important for AI search visibility.
Related terms
A website's ability to be discovered, crawled, and recommended by AI-powered search engines including ChatGPT, Perplexity, Claude, and Gemini.
A proposed standard file placed at a website's root (like robots.txt) that provides structured guidance to AI language models about the site's content.
A text file at a website's root that instructs search engine crawlers which pages or sections of a site should not be crawled.
Perplexity AI's web crawler used to power Perplexity's AI search answers with real-time web content.
Monitor GPTBot continuously
AuditJet tracks Core Web Vitals on a schedule with revenue impact alerts.
Start Free