Perplexity AI's web crawler used to index and retrieve content for real-time AI search responses.
PerplexityBot is Perplexity's web crawler that continuously indexes content to power Perplexity's AI search engine. Unlike training-focused crawlers, PerplexityBot operates like a traditional search crawler but optimized for AI retrieval. It prioritizes fresh, authoritative content with clear citations. Perplexity heavily features source citations in responses, making PerplexityBot access particularly valuable for driving referral traffic. Allowing PerplexityBot is essential for visibility on Perplexity's growing AI search platform.
Qwairy classifies observed PerplexityBot requests and their retained frequency. Compare them with separately monitored Perplexity citations without assuming that one caused the other.
Automated web client operated by an AI company for model training, AI search, or user-requested retrieval.
Conversational search engine that combines LLM and real-time web search with source citations.
Text file placed at the root of a website to indicate to indexing robots which pages to explore or avoid.
Reference to a URL or website as a source of information in an AI response.