apifystats
Log in Start free
Actor/eliai

robots.txt Analyzer — Rules, Sitemaps & Crawl Blocks

SEO / SERP

Parse and audit any site's robots.txt in one call: user-agent groups, allow/disallow rules, declared sitemaps, and crawl-block issues like an accidental site-wide Disallow. $0.02 per site analyzed. No API key.

Publisher description, verbatim
Last 7 dayson this actor
  • 2other changes
Each one reaches followers by email the morning after.Follow this actor
Key figures30 readings
Price / 1k$20.00per 1,000 robots-analyzed
Users / 30d1→ 0 over 30 readings
Users, all time2→ 0 over 30 readings
Runs / 30d28↓ 1 over 30 readings
Runs / user / mo28.0runs per monthly user
Recorded changes
  • 2026-09-25schemaInput schema changed—on record
  • 2026-09-25contentREADME updated+1,540 characters+1,540characters
showing 2 of 2 in the last 30 days · followers get the next one by email

History

30 readings since 2026-08-27
Users / 30d30 readings
08-27→ 009-25
Users, all time30 readings
08-27→ 009-25
Runs / 30d30 readings
08-27↓ 109-25

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.