Compare
SiteRune vs Botify, Oncrawl, and enterprise log crawlers
· Configuration notes, not a newsroom.
Enterprise crawlers ingest logs and millions of URLs. SiteRune is a senior-engineer brief for a host you paste today. Different budget, different output.
Scale
Botify and Oncrawl are how a retailer watches crawl budget across a million SKUs. SiteRune walks a handful of URLs on purpose. If you need log-based crawl budget, you are not our customer for that job.
What they rarely attach
A paste-ready CSP, a WordPress mu-plugin, and an llms.txt draft in the CMS dialect. Use the enterprise crawler for the estate. Use SiteRune for the origin the brand actually ships this week — including AEO, which log crawlers still treat as a footnote.
Run it on a live URL
The brief will name your CMS and attach the files. Three guest scans, no card.