Free tools
Check what crawlers can actually read.
Test one page, compare raw and rendered HTML, or scan several URLs without creating an account.
What does a crawler receive from this page?
Bot View Checker
Inspect the crawler-facing response, readable content, headings, metadata, links, and app-shell signals.
Check one page ↗Does JavaScript add important page content?
Raw vs Rendered HTML
Compare the initial HTML response with the browser-rendered page and see what appears only after JavaScript runs.
Compare both versions ↗How readable is this page at a glance?
JavaScript SEO Score
Get a compact score based on crawler-visible content and core page signals.
Run a quick audit ↗Can search and AI crawlers access the site?
Robots + llms.txt
Review robots.txt rules, sitemap discovery, and llms.txt availability.
Check access files ↗Do several pages have the same visibility issue?
Bulk Readability Scan
Scan up to 10 sitemap or pasted URLs for thin HTML, metadata, and app-shell patterns.
Scan multiple pages ↗Check the current page without leaving your browser.
The Prerender Buddy Chrome extension is a free crawler-readability companion to the broader Prerender Buddy platform. Use it for a quick check while reviewing a site, then open the web tools when you need a deeper comparison.
Add to Chrome ↗The signals needed to diagnose crawler readability.
Visible content
Readable text, headings, internal links, and the raw-to-rendered content gap.
Page signals
Title, meta description, canonical URL, and structured data when available.
Crawler access
robots.txt rules, llms.txt presence, sitemap discovery, and multi-page coverage.
Bring checks into your workflow.
Use the browser extension, CLI or developer integrations to check crawler access where you work.
Explore developer tools ↗