Which AI Bots Are Actually Crawling You?
Crawler Check-In logs every AI and search bot that visits your site, server-side, across 41 known crawlers. It shows who came, which pages they read, and, just as important, which of your pages no AI bot has reached yet.
The crawlers reading you are mostly AI
A recent snapshot from a live Triomize site. Look at the split: for every search-engine bot that visited, nearly forty AI crawlers showed up. These are the visitors deciding whether your content gets cited, and most site owners never see a single one of them.
Crawler Check-In records this for your own site, server-side, with a named entry for every visit.
Crawler Check-In answers a question most tools cannot: are the AI engines actually reaching your content? It records the user-agent of every crawler that hits your site and sorts them into AI bots and search bots, with a named, badged entry for each visit.
This matters because being citable is not the same as being crawled. In the research that defined generative engine optimization, presented at ACM KDD 2024, adding citations, statistics, and quotations to a page lifted its visibility in AI answers by more than 40%, while old tricks like keyword stuffing did nothing at all. But none of that can happen if the crawler never arrives. Crawler Check-In shows you, page by page, whether it did.
You cannot earn a citation on a page an AI engine has never read.
What Crawler Check-In Shows You
Recent visits
A live table of the most recent crawls: time, the named crawler with an AI or Search badge, the exact page, and the IP, all captured on your own server.
Crawlers seen
Per-bot visit totals, so you can see at a glance whether GPTBot, ClaudeBot, PerplexityBot and the rest are showing up, and how often.
Most-crawled pages
Your top pages by crawler hits, so you know which content the engines return to most.
Coverage gap
The list that matters most: published pages no AI bot has visited yet. Every page here is a citation you cannot win until it gets crawled.
41 bots, your choice
Toggle any of 41 built-in crawlers on or off, or add a custom one by user-agent token. Off means ignored entirely.
Cache-bypass
If a full-page cache serves bots a cached copy, the visit never reaches PHP to be logged. Switch on cache-bypass and Triomize auto-configures supported caches so every crawl is captured.
There is also an admin-bar badge showing today's AI-hit count, so you see crawler activity without leaving the page you are working on.
Crawler access is a GEO score, not just a log
Allowing AI crawlers is the single largest signal on the GEO matrix, worth 16 of its 100 points. Crawler Check-In is how you confirm the bots you allowed are really coming through. Once they are, make sure new pages reach the indexes fast with Search Indexing, and see the whole setup in the install guide.
