AI Crawler Log for WordPress | AEO God Mode
Free crawler controls and log

AI Crawler Control & Visit Log for WordPress.

Set clear robots.txt rules for AI crawlers, then verify which bots visited, which URLs they requested, and whether your server returned the page.

Watch how crawler rules and real visit evidence work together—without confusing a crawl with a citation.
Control, then verify

A robots.txt rule is policy. The Visit Log is evidence.

The Allowlist controls the instructions your site serves. The Visit Log records recognised AI crawler requests that reached WordPress. You need both to understand access.

Set an explicit rule

Choose No rule, Allowed, or Disallowed for editable AI search, user-fetch, training, and data-use crawlers.

Protect search access

Core search crawlers are shown but protected from accidental blocking inside this screen.

Read real visits

See the crawler name, requested URL, response code, and time for each recorded request.

What does “No rule” mean?

No rule is not the same as Disallowed. It means AEO God Mode has not added an explicit rule for that crawler, so the crawler may visit by default unless another robots.txt rule blocks it. Changes are not written until you press Save Changes.

Free and Pro

The crawler controls and visit log are free.

Free includes the Allowlist, recent totals, bot activity, the most-crawled page summary, and the raw Visit Log. Pro adds the full Top Crawled Pages list and Content Blind Spots so you can find published posts no recognised AI crawler has visited.

Stop guessing which AI bots can read your site.

Install AEO God Mode Free, set your crawler rules, and use the Visit Log to check what actually reached WordPress.

AI Search Optimized by AEO God Mode (opens in a new tab)