AI Crawler Checker
See which AI bots your robots.txt allows or blocks
Visit WebsiteAbout AI Crawler Checker
Paste a domain and get a verdict for 20 AI crawlers (GPTBot, ClaudeBot, Google-Extended and more) with the exact robots.txt rule behind each. Includes a llms.txt generator and validator. Free, no account.
More Products
Side Projects
Productivity
GPA 4.5 Converter
Convert a 4.5- or 4.3-scale GPA to the 4.0 scale, three ways
Side Projects
Productivity
Creator Payout Calculator
Compare take-home pay across 5 creator platforms