apifystats
Log in Start free
Actor/eliai

Robots Rule Tester - Would Google Crawl This URL?

Monitoring

Test URLs against robots.txt with real Google semantics: longest-match, Allow wins ties, UA group selection (test Googlebot, GPTBot, ClaudeBot...), wildcards. Verdict + the exact rule that decided it + sitemaps. $0.0008 per URL, invalid URLs never charged — vs $0.001-$0.15 measured incumbents.

Publisher description, verbatim
Last 7 dayson this actor
  • 1other change
Each one reaches followers by email the morning after.Follow this actor
Key figures30 readings
Price / 1k$0.80per 1,000 test-run
Users / 30d1→ 0 over 30 readings
Users, all time2→ 0 over 30 readings
Runs / 30d28↑ 15 over 30 readings
Runs / user / mo28.0runs per monthly user
Recorded changes
  • 2026-09-25contentREADME updated+441 characters+441characters
showing 1 of 1 in the last 30 days · followers get the next one by email

History

30 readings since 2026-08-27
Users / 30d30 readings
08-27→ 009-25
Users, all time30 readings
08-27→ 009-25
Runs / 30d30 readings
08-27↑ 1509-25

Follow this actor, compare it against its rivals, and get every overnight change in one morning report.

Publish it yourself? Claim your publisher page and its full history is yours free, forever.

Open in the app Claim this page

Numbers on this page are measured only by an independent census of the Apify Store — not self-reported.