NEWv1.17: Audited & Actionable
Technical

See every AI bot that visits. Every human it sends. Every dollar it earns.

Track 15+ AI crawlers and the real human traffic they send back.

100 credits free. No credit card required.

Trusted by 2,000+ brands and agencies

TotalEnergies logo
TotalEnergies
Air Transat logo
Air Transat
Match Group logo
Match Group
Fortuneo logo
Fortuneo
IZI by EDF logo
IZI by EDF
Meilleurtaux.com logo
Meilleurtaux.com
Agicap logo
Agicap
Pennylane logo
Pennylane
Aroma-Zone logo
Aroma-Zone
Razorfish logo
Razorfish

The problem

AI crawlers hit your site every hour. Without log analysis, you cannot tell if GPTBot indexed your launch, if ClaudeBot respects your directives, or whether Anthropic Google-Extended opt-out is working. Meanwhile, referrer traffic from ChatGPT and Perplexity shows up in Google Analytics as direct or unknown.

What it does

AI Crawler Analytics detects GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 10+ other AI crawlers via log analysis. Paired with referrer detection, you get a unified funnel from crawler hit to human referrer to revenue, closing the measurement loop.

Inside the feature

  • 15+ AI crawlers tracked
  • Referrer detection for ChatGPT, Perplexity, Gemini traffic
  • Unified crawler to referrer to revenue funnel
  • Multiple deployment options (Cloudflare, Vercel, AWS, Fastly)
  • Per-page and per-bot breakdown

Why Qwairy is different

Most tools

Track Googlebot hits only.

Qwairy

15+ AI crawlers detected (GPTBot, ClaudeBot, PerplexityBot, Google-Extended).

Most tools

Miss ChatGPT and Perplexity referrers as '(direct)'.

Qwairy

Detect and attribute every AI referrer accurately.

Most tools

Require complex log shipping setup.

Qwairy

Zero-friction deploy via Cloudflare Worker, Vercel log drain or AWS.

How it works

1

Deploy the log drain

Pick your deployment: Cloudflare Worker, Vercel log drain, AWS CloudFront, Fastly, Akamai or generic HTTP endpoint.

2

Detect and classify

Qwairy parses access logs for AI crawler user-agents: GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 10+ more.

3

Correlate with referrer data

Crawler visits link to referrer sessions and downstream conversions. Full crawl-to-revenue funnel.

Use cases

01

Crawler coverage verification

Check that GPTBot, ClaudeBot and PerplexityBot all indexed your latest pages within 48 hours of publish.

02

Traffic source attribution

Detect ChatGPT and Perplexity referrers that Google Analytics misses. Build a proper AI traffic funnel.

03

Crawler behavior audit

Verify that AI crawlers respect your robots.txt directives. Catch crawlers that ignore rules (and block them at the edge).

FAQ

Frequently Asked Questions

Common questions about Crawler Analytics.

Depends on deployment. Cloudflare Worker is zero-friction. Vercel log drain is one config change. Server log ingestion requires log shipping.

Ready to unlock Crawler Analytics?

Start free with 100 credits and the full feature set. No credit card required.