apifystats
Log in Start free
Actor/accountable_eel

AI Crawler Policy Checker: robots.txt & llms.txt

Monitoring

Check what a website's robots.txt says about AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and more) and whether it publishes an llms.txt. Reads the site's own public files directly: no API key, no third-party service. Charged only when an explicit AI policy or llms.txt is found.

Publisher description, verbatim
Last 7 dayson this actor
  • 1other change
Each one reaches followers by email the morning after.Follow this actor
Key figures16 readings
Price / 1k$4.00per 1,000 item-lookup
Users / 30d1→ 0 over 16 readings
Users, all time2→ 0 over 16 readings
Runs / 30d23↑ 14 over 16 readings
Runs / user / mo23.0runs per monthly user
Recorded changes
  • 2026-09-19changeTitle changed—on record
  • 2026-09-14changeTitle changed—on record
  • 2026-09-14contentDescription changed—on record
showing 3 of 5 in the last 30 days · followers get all 5 by email

History

16 readings since 2026-09-10
Users / 30d16 readings
09-10→ 009-25
Users, all time16 readings
09-10→ 009-25
Runs / 30d16 readings
09-10↑ 1409-25

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.