NEWv1.17: Audited & Actionable
Qwairy
Technical

See every AI bot that visits. Every human it sends. Every dollar it earns.

Track 15+ AI crawlers and the real human traffic they send back.

Deploy crawler trackingGet a demo

120 credits free. No credit card required.

PlayPlay
API AND YOU
1&1 Versatel
MAIF
Tiime
Nissan

The problem

AI crawlers hit your site every hour. Without log analysis, you cannot tell if GPTBot indexed your launch, if ClaudeBot respects your directives, or whether Anthropic Google-Extended opt-out is working. Meanwhile, referrer traffic from ChatGPT and Perplexity shows up in Google Analytics as direct or unknown.

What it does

AI Crawler Analytics detects GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 10+ other AI crawlers via log analysis. Paired with referrer detection, you get a unified funnel from crawler hit to human referrer to revenue, closing the measurement loop.

Inside the feature

  • 15+ AI crawlers tracked
  • Referrer detection for ChatGPT, Perplexity, Gemini traffic
  • Unified crawler to referrer to revenue funnel
  • Multiple deployment options (Cloudflare, Vercel, AWS, Fastly)
  • Per-page and per-bot breakdown

Why Qwairy is different

Most tools

Track Googlebot hits only.

Qwairy

15+ AI crawlers detected (GPTBot, ClaudeBot, PerplexityBot, Google-Extended).

Most tools

Miss ChatGPT and Perplexity referrers as '(direct)'.

Qwairy

Detect and attribute every AI referrer accurately.

Most tools

Require complex log shipping setup.

Qwairy

Zero-friction deploy via Cloudflare Worker, Vercel log drain or AWS.

How it works

1

Deploy the log drain

Pick your deployment: Cloudflare Worker, Vercel log drain, AWS CloudFront, Fastly, Akamai or generic HTTP endpoint.

2

Detect and classify

Qwairy parses access logs for AI crawler user-agents: GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 10+ more.

3

Correlate with referrer data

Crawler visits link to referrer sessions and downstream conversions. Full crawl-to-revenue funnel.

Use cases

01

Crawler coverage verification

Check that GPTBot, ClaudeBot and PerplexityBot all indexed your latest pages within 48 hours of publish.

02

Traffic source attribution

Detect ChatGPT and Perplexity referrers that Google Analytics misses. Build a proper AI traffic funnel.

03

Crawler behavior audit

Verify that AI crawlers respect your robots.txt directives. Catch crawlers that ignore rules (and block them at the edge).

FAQ

Frequently Asked Questions

Common questions about Crawler Analytics.

Depends on deployment. Cloudflare Worker is zero-friction. Vercel log drain is one config change. Server log ingestion requires log shipping.

Very high for declared bots (GPTBot, ClaudeBot, PerplexityBot) which use standard user-agents. Stealth crawlers are detected via IP range analysis and behavioral signals.

Yes. Qwairy surfaces the crawler, and you can block via robots.txt or at the edge (Cloudflare, Vercel). Qwairy confirms the block took effect.

SaaS. The log drain deploys on your edge (Cloudflare, Vercel, AWS). Logs are ingested and processed by Qwairy servers.

Yes. Log volume scales linearly. Enterprise plans include dedicated ingest pipelines for high-traffic domains.

Ready to unlock Crawler Analytics?

Start free with 120 credits and the full feature set. No credit card required.

Deploy crawler trackingGet a demo
Previous
AI Readiness
Next
Enterprise SSO (OIDC)
Back to All Features