Free website audit tools

Each tool runs a real check from the SiteRune engine — headers, robots, AI crawlers, canonicals, llms.txt, or CMS fingerprints. No fake widgets. The complete audit is still the punch list.

• Security Headers Checker
  Check HTTPS, HSTS, CSP, X-Frame-Options, nosniff, Referrer-Policy, and Permissions-Policy on a live URL. Same public-header chapter as a SiteRune audit. Not a pentest.
• robots.txt Checker
  Fetch and parse robots.txt: user-agent blocks, Disallow: /, and Sitemap declarations. The same parser SiteRune uses in the SEO chapter.
• AI Crawler Checker
  See whether robots.txt blocks GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and other named AI crawlers. Parses the file; does not crawl as those bots.
• Canonical URL Checker
  Extract the canonical link from a live page and compare it to the final URL after redirects. Flags missing, relative, or cross-host canonicals.
• llms.txt Validator
  Fetch /llms.txt and check whether it is a usable URL map. SiteRune scores thin marketing files as a miss. llms.txt is not a confirmed Google ranking factor.
• CMS Detector
  Fingerprint the CMS or framework from public HTML, headers, and cookies. Same detector as a SiteRune audit. Confidence is a score, not a certificate.