- ~80%
- fall in verified ChatGPT-User requestsmid-August to mid-October, weekly snapshots
- ~2x
- rise in verified OAI-SearchBot requestsover the same weeks
- ~26x
- growth in distinct sources running Claude CodeJune to September, mostly on technical documentation
- ~1.5bn
- server requests reviewedacross the sites Salience monitors
There has been a run of studies on how much traffic AI assistants send to websites, from Marie Haynes, Kevin Indig, The SEO Works, Rand Fishkin and Michael King, on different datasets and with different methods. On referrals, the log data broadly agrees with them: AI referral traffic is small next to Google organic. Server logs also record a layer of activity that analytics tools never see, because it is bots fetching pages, and that layer changed shape over the last two months.
Where the data comes from
The figures are from server and CDN logs for the sites Salience monitors, around 1.5 billion requests between mid-August and mid-October 2026. Each OpenAI request is counted only when its source IP address falls inside the ranges OpenAI publishes for that bot, so a user agent string on its own is not enough. The weekly values are approximate snapshots, indexed so that the mid-August week equals 100 for each bot.
| OpenAI user agent | What it does | Appears in analytics |
|---|---|---|
| ChatGPT-User | Fetches a page during a conversation | No |
| OAI-SearchBot | Crawls pages in advance for the ChatGPT search index | No |
| GPTBot | Crawls for model training; not part of this comparison | No |
Live reads fell while crawling doubled
ChatGPT-User requests fell in every one of the nine weeks and ended at about a fifth of their mid-August level. OAI-SearchBot requests rose in every week and ended at a little over twice their mid-August level. The two lines crossed in the second half of September.
The pattern is consistent with ChatGPT crawling and indexing content in advance and answering from that index, in place of fetching pages during individual conversations. The logs show the request mix, not the reason for it.
Claude Code reached far more sites
Over a longer window, June to September, the number of distinct sources making requests identified as Claude Code grew about 26 times. Most of those requests were for technical documentation: API references, install guides and changelogs. That traffic is a coding agent reading pages on a developer's behalf, and it reaches the server without a browser or an analytics tag.
| Operator | Agent | Window | Change |
|---|---|---|---|
| OpenAI | ChatGPT-User | Mid-August to mid-October | Verified requests down about 80% |
| OpenAI | OAI-SearchBot | Mid-August to mid-October | Verified requests up about 2x |
| Anthropic | Claude Code | June to September | Distinct sources up about 26x |
Referrals, agent activity and indexing are three different measures
On referrals, Marie Haynes' study of 100 sites over 12 months of GA4 data put ChatGPT sessions at 0.62% of Google organic volume, and 0.73% with every other assistant included. The SEO Works benchmark found 3.2 AI-referred conversions for every 100 from organic search. The log data across the monitored sites agrees that referrals from assistants are small next to Google.
An AI agent fetching a page does not mean a person saw a recommendation, and it does not mean a purchase. It does mean the page was read and could be quoted, indexed or acted on. A crawl by OAI-SearchBot means the page can appear in ChatGPT search results later. A referral means a person clicked through. Each one is reported from a different source and answers a different question, so they belong in separate columns.
What to do with this
- 01Report AI referrals, agent fetches and crawler indexing as three separate figures, each from the source that records it: analytics for referrals, server logs for the other two.
- 02Count bot requests only when the source IP is inside the ranges the operator publishes. OpenAI, Anthropic, Google and others publish them. Salience applies this check to every request it classifies.
- 03Watch which pages OAI-SearchBot crawls and how often. If ChatGPT is answering from its index, the index is what decides whether a page can be cited.
- 04Decide per bot what to allow. ChatGPT-User, OAI-SearchBot and GPTBot have different jobs, so one robots rule for all of them is rarely the right answer. The bot management guide sets out the choices.
Sources
- GEO is a distraction, Marie Haynes, 21 October 2026. ChatGPT sessions at 0.62% of Google organic across 100 sites and 145 million sessions.
- AI Referral Traffic 2026: How Much, And Does It Convert?, The SEO Works, 2026. AI referrals and conversions against organic search.
- OpenAI crawler and user agent documentation, the published behaviour and IP ranges for ChatGPT-User, OAI-SearchBot and GPTBot.