AI Crawler Activity

* Grok* is a best guess, not a confirmed xAI crawler. xAI publishes no crawler name or IP ranges, so this row counts bursts where several IPs in different countries open the same page within seconds without loading its styles, scripts or images — the pattern of a Grok answer fetching a page. 0 means no qualifying burst.

* Muse* is a best guess, not a confirmed Meta crawler. It counts fetches from Meta’s Fastly network (2a04:4e41::/32) that use a script or stripped-down browser user agent and read several pages or robots.txt / llms.txt / sitemap.xml without loading page assets — the pattern of Meta’s Muse agent checking a site. Full Safari/Chrome visitors from that network (iCloud Private Relay users) are never counted. 0 means nothing qualified.

Bots that name themselves in their user-agent but don’t match any crawler we track individually. Grouped into one row; excluded from every crawler total.

🏴‍☠️ Attack probes (wp-admin, .git, .env, config files and the like) and known scanner tools. Total requests only; breakdown removed. Kept out of every crawler total above.