AI Crawler Logs

See the AI bots on your website

Every time ChatGPT, Perplexity, Claude, or Google AI fetches a page on your site, we log it. Hour-by-hour charts, provider breakdown, top crawled pages.

AI bots we detect
OP
ChatGPT-User
OpenAI
83%
PE
PerplexityBot
Perplexity
17%
AN
ClaudeBot
Anthropic
0.2%
GO
GoogleOther
Google
โ€”
AP
Applebot-Extended
Apple
โ€”

Real data from robot-speed.com. 5 of 12 tracked bots shown.

What You See

Every AI visit, logged and analyzed

01

Real-Time Bot Detection

We identify ChatGPT-User, PerplexityBot, ClaudeBot, GoogleOther, Applebot-Extended, GrokBot, and 6 more AI crawlers.

Training bots (GPTBot, CCBot) are filtered out. Only citation-relevant crawlers are tracked.

02

Hourly & Daily Charts

See when AI bots visit your site broken down by hour and day. Spot patterns: ChatGPT peaks at 2-4pm UTC.

Filter by provider, time range (24h, 7d, 30d, 90d), and compare periods.

03

Top Crawled Pages

Know which of your pages AI bots read most. Blog posts with structured data get 3x more visits.

Real example: /pricing gets crawled 3x/day by ChatGPT but never cited.

04

Crawl-to-Citation Ratio

Not every crawl becomes a citation. Track how many crawled pages actually get mentioned in AI answers.

robot-speed.com: 384 pages crawled, 4 cited = 1% ratio.

Integrations

Works with your stack

Connect in under 5 minutes. No code changes needed for most platforms.

VercelLog drain, 2 clicks
CloudflareWorker script, 3 min
WordPressFree plugin, 1 click
NetlifyLog drain, 2 clicks
AWS / GCPLambda / Cloud Function
Manual APIPOST endpoint, any platform
How It Works

From server log to insight

01

Connect your logs

Point your server logs at our endpoint. Vercel, Cloudflare, WordPress, or raw API.

02

We filter and classify

Our engine identifies 12 AI crawlers, filters training bots, deduplicates hourly, and maps visits to pages.

03

You see the data

Real-time dashboard with charts, provider breakdown, top pages, and crawl-to-citation ratio.

FAQ

What AI bots do you track?+

We track 12 AI crawlers: ChatGPT-User, PerplexityBot, ClaudeBot, GoogleOther, Applebot-Extended, GrokBot, MistralBot, DeepSeekBot, and more. Training-only bots are filtered out.

Will this slow down my website?+

No. We read your server logs, not your website traffic. Zero impact on page load speed.

What is the difference between a crawl and a citation?+

A crawl means an AI bot fetched your page. A citation means your page was mentioned in an AI answer. Your crawl-to-citation ratio shows how useful AI finds your content.

How do I set up the WordPress plugin?+

Install the Robot Speed plugin from WordPress admin. It auto-detects AI bot visits and sends them to your dashboard. No configuration needed.

Can I track multiple sites?+

Yes. Each site gets its own crawler log dashboard with isolated data.

See which AI bots visit your site

Set up in under 5 minutes. Real-time dashboard with hourly charts and provider breakdown.

AI Crawler Logs โ€” See When ChatGPT, Perplexity & Claude Visit Your Site