A live directory of every crawler, bot and AI agent

Every bot and AI agent seen across the sites Salience monitors, classified by what it does, checked against the operator's published IP ranges where one exists, and ranked by request volume.

Aggregated across every Salience-monitored site. Request counts and site reach only, never an individual site, and no personal data.

Salience networkLive
Named crawlers verified against published IP ranges
  • Googlebot
  • Bingbot
  • GPTBot
  • ClaudeBot
  • PerplexityBot
  • Applebot

Every crawler and agent seen, ranked by requests

Verified, source IP matched the operator's official range Unverified, source IP isn't in the operator's official range (may be spoofed, or a proxy/CDN rewrote the IP) Can't verify, no original source IP reached us, or no public range exists
All Named AI Search Ads SEO tools Social Scripts Unclassified
Crawler or agent
Operator
Type
Prevalence
Verification

How the directory is built

Where the figures come from

Every row is aggregated across the sites Salience monitors. A crawler's prevalence is its request count for the month and the share of monitored sites it appeared on. No individual site is shown and no personal data is kept.

How verification works

Where an operator publishes IP ranges, each request claiming that crawler is checked against them. Verified means the source IP was inside the range. Unverified means it was outside, which covers spoofing and proxies that rewrite the client IP. Can't verify means no source IP reached Salience, or the operator publishes no range.

Named and observed

A named crawler has a published identity and is checked against its operator's ranges where they exist. An observed agent is a user agent seen in the logs and counted, with no range to check it against. Open any row for the user agent string, its robots.txt token and a recommended policy.

Common questions

How often does the directory update?

The figures cover one month, named in the panel at the top of the page, and update as Salience refreshes the dataset.

What does unverified mean?

The request presented a named crawler's user agent from an IP address outside the ranges that operator publishes. The address may be spoofed, or a proxy or CDN in front of the site may have rewritten the client IP before the request reached Salience.

Why can some crawlers not be verified at all?

Either the operator publishes no IP range, so there is nothing to check against, or no original source IP reached Salience because a proxy or CDN replaced it. Those requests are counted separately rather than guessed at.

Is my site's data in here?

Only as part of the aggregate. The directory shows request counts and how many monitored sites each crawler reached. It never shows an individual site, a URL or a client address.

How do I see which of these crawlers are on my site?

Connect a log source to Salience. It classifies every request to your own domain in real time, verifies each crawler where the operator publishes ranges, and alerts you when impersonators surge. To check a single address, use the fake Googlebot checker.

Aggregated across every Salience-monitored site · August 2026 · no personal data, traffic counts and site reach only, never individual sites. Figures update as we refresh the dataset.

See which of these crawlers are on your site, verified request by request.

Salience classifies every request to your own domain in real time and checks each crawler against the operator's published ranges.