Set an explicit rule
Choose No rule, Allowed, or Disallowed for editable AI search, user-fetch, training, and data-use crawlers.
Set clear robots.txt rules for AI crawlers, then verify which bots visited, which URLs they requested, and whether your server returned the page.
The Allowlist controls the instructions your site serves. The Visit Log records recognised AI crawler requests that reached WordPress. You need both to understand access.
Choose No rule, Allowed, or Disallowed for editable AI search, user-fetch, training, and data-use crawlers.
Core search crawlers are shown but protected from accidental blocking inside this screen.
See the crawler name, requested URL, response code, and time for each recorded request.
No rule is not the same as Disallowed. It means AEO God Mode has not added an explicit rule for that crawler, so the crawler may visit by default unless another robots.txt rule blocks it. Changes are not written until you press Save Changes.
Free includes the Allowlist, recent totals, bot activity, the most-crawled page summary, and the raw Visit Log. Pro adds the full Top Crawled Pages list and Content Blind Spots so you can find published posts no recognised AI crawler has visited.
Install AEO God Mode Free, set your crawler rules, and use the Visit Log to check what actually reached WordPress.