Free tools / AI bot analytics
AI bot analytics: which AI crawlers read your site?
Our AI bot analytics counts the requests in your server log that name each of 13 AI and search crawlers, by day, page and status, and lists other automated software. Choose an access log or CSV export; your browser reads it and nothing is uploaded. Each count is of requests that claim a name, with the steps to verify a sample.
Free, with these limits: one file at a time, up to 25 MB and 300,000 lines, in combined or common log format (Apache, Nginx), JSON lines, W3C extended logs, or CSV or tab-separated files with a header row that names the user agent and path columns. There is no account and no saved history.
No email is needed. Your browser reads the file on your device; nothing is uploaded, and this page is not allowed to make network requests. A shared result stays in its link, not on our server.
What we check and why
Crawlers on our published list
Requests are matched to the 13 crawlers and tokens on the list in our crawler identity inspector, by whole name in the user agent, so Googlebot-Image is not read as Googlebot.
By day, page and status
For each crawler: requests, distinct pages, the status classes it got, its busiest pages, and its requests for robots.txt, llms.txt and sitemaps. Days are UTC.
Claims, not proof
A user agent is text the sender chooses. Each count is of requests that claim a name; for each crawler we list up to three public addresses from your log to check against the operator's published IP ranges or reverse DNS.
Other automated software
Requests that look automated but name no crawler on our list are grouped by the name they give, so you can see scripts, monitors and scrapers.
Limits of this free tool
One file at a time, up to 25 MB and 300,000 lines, with no saved history or schedule. Split a larger log by day.
Questions
How can I see which AI crawlers visit my site?
Your server or CDN access log records the user agent of every request. Load it here and we count the requests that name each AI and search crawler on our list, by day and page.
Are these counts verified?
No. A user agent is text the sender chooses, so each count is of requests that claim a name. For a sample address, the operator's published IP ranges or a reverse DNS lookup confirm the claim; the crawler identity inspector shows the steps.
What are the limits of the free version?
One file at a time, up to 25 MB and 300,000 lines, in the formats listed above. There is no account, no saved history and no scheduled report; split a larger log by day.
Want the fix made for you?
Answer Repair completes one agreed source-backed page or fix. Choose Live or Handoff before payment. Due 48 elapsed hours after Ready. Full refund on request within 30 days of delivery.
When you want us to do the work, every offer and its published price is on our offers page. More free checks: the ChatGPT Business Hub readiness check, the crawler identity inspector, the web analytics tool and the robots.txt tester, or see all free tools. Read next: How can you see which AI crawlers visit your site?, How can server logs show whether AI crawlers request llms.txt? and How do AI search crawlers differ from AI training crawlers?