Google Cloud CDN
Send your Google Cloud CDN logs to Robot Speed via Pub/Sub and Log Router. We automatically filter AI bot visits.
Prerequisites
- ✓A GCP project with Cloud CDN or Cloud Load Balancing
- ✓Access to Pub/Sub and Log Router
- ✓Your Robot Speed API key (Settings → API)
1
Create a Pub/Sub topic
- Google Cloud Console → Pub/Sub → Create topic
- Name:
robotspeed-crawler-logs
2
Create a Push Subscription
Create a subscription on the topic with:
Delivery type
PushEndpoint URL
https://www.robot-speed.com/api/ai-bot-visits/gcpAuthentication header
X-API-Key: your_rs_api_key3
Configure Log Router
- Go to Logging → Log Router → Create sink
- Sink destination: Cloud Pub/Sub topic → select
robotspeed-crawler-logs - Inclusion filter:
resource.type="http_load_balancer"
httpRequest.requestUrl:"yourdomain.com"Verification
AI crawler data will appear in your Robot Speed dashboard within minutes. We automatically filter to keep only citation bots.