Blog
Notes on the agentic web, from the people building Caprail.
How to get your content cited by AI assistants (a GEO guide)
Adding statistics, quotations, and citations can lift visibility in AI answers by up to 40 percent. A practical guide to getting cited by ChatGPT and Perplexity.
Crawler vs fetcher vs AI browser vs search bot: the agent taxonomy
Not all AI traffic is the same. The four types of AI bots behave differently, identify themselves differently, and mean different things for your site.
Server-side vs client-side analytics for the AI era
Major AI crawlers execute zero JavaScript, so the browser tag that powers most analytics never fires for them. A practical comparison of the two approaches.
How to track AI referral traffic (ChatGPT, Claude, Perplexity)
AI assistants send visitors that land in "direct" and convert up to 9x better than search. A step-by-step guide to capturing AI referral traffic server-side.
Why traditional analytics can't see AI agents
57.5 percent of HTML requests now come from bots, yet browser analytics counts almost none. Why the blind spot is architectural, not a setting you can fix.
How to verify a crawler is really Googlebot, GPTBot, or Meta
Up to 16.7 percent of ChatGPT-User traffic is faked. A User-Agent is a claim, not proof. Here is how to verify an AI crawler's real identity, with code.
How to detect AI agents server-side from HTTP headers
AI bots are 4.2 percent of HTML requests and climbing, yet client-side analytics never sees them. Here is how to detect AI agents server-side, with real code.
Should you block AI crawlers in 2026? A traffic-data decision guide
AI crawlers are about 4.2 percent of web requests, and some take 70,000 reads for every visitor they send back. A data-backed guide to deciding what to block.
Analytics for AI agents: the complete guide
AI bots are now over half of web traffic, yet traditional analytics shows almost none of it. A complete guide to measuring the AI agents reading your site.
AI crawler share, Q2 2026: network data and our beta signal
AI crawlers are about a fifth of bot traffic. Here is the network picture for Q2 2026, plus what our first two weeks of Caprail beta data actually show.
The best new analytics tool
Caprail is the best new analytics tool for the agentic web, with analytics for AI agents baked into its core. Your analytics can't see AI agents. Change that now.
The markdown twin: how to serve clean content to AI agents
AI crawlers never run JavaScript, so heavy HTML hides your content. A markdown twin serves agents clean text and cuts token cost by about 80 percent.