Crawlie (crawlie.co)

Crawlie is a crawler for your agents to audit your SEO and GEO (how ready your site is for AI search). Instead of clicking through a desktop tool like Screaming Frog, you hook Crawlie up to Claude, Cursor, or any MCP client and just ask things like "crawl my site and give me the top fixes." It finds broken links, redirect chains, missing metadata, thin content, and AI-readiness gaps like missing llms.txt or structured data, then hands your agent a report it can actually act on.