Free page check · no email
Check all pages on a website (free)
Paste a website address. We'll read its sitemap, check up to 50 pages for 404s, redirects and noindex, and flag homepage links that never made it into the sitemap. No email, nothing to install.
We identify as CrawlCarePageCheck and stop at 50 page requests. Also try the plugin check or PHP2Shell check.
How to check all pages
Three ways to see every page.
Your sitemap, Google's own reports, or a crawler like this one. Here's when each one helps, and what to do with 404s, redirects and noindex.
Your own list
Open /sitemap.xml (or whatever robots.txt points at). If a real page isn't there, Google may never find it. If a deleted page still is, fix or remove it.
site: and Search Console
Search site:yourdomain.com for a rough view. For the real answer, Search Console → Pages shows what Google indexed, and why it skipped the rest.
This tool
We read the sitemap, request up to 50 URLs, and report status, redirects and noindex. Homepage links missing from the sitemap show up as a short list.
What to do with the results
- 404 or 5xx. Restore the page, or 301 the URL to the closest live one. Don't leave soft-404s that return 200 with "not found" copy.
- Redirects. Fine when intentional. Chains (A→B→C) waste crawl budget and confuse people — point A straight at C.
- noindex. Right for thank-you pages and staging. Wrong for a service page you want in Google. Check the meta robots tag and
X-Robots-Tag. - Homepage links missing from the sitemap. Decide if each one should be public and crawlable. If yes, add it to the sitemap (or fix the plugin that builds it).
Want the longer checklist, including titles, speed and HTTPS? Read how to check your website SEO for free.
Questions
How do I check all pages on a website?
Three common ways: open your XML sitemap and walk the list, use Google's site: search or Search Console's Pages report, or run a crawler like this one. This tool reads your sitemap (or your homepage links if there isn't one), then status-checks up to 50 URLs for 404s, redirects and noindex.
What does this tool actually check?
It looks for a sitemap in robots.txt and at the usual addresses, lists up to 500 URLs, then requests up to 50 of them. For each one we report the final status code, whether it redirected, and whether X-Robots-Tag or a meta robots tag says noindex. We also list homepage links that aren't in the sitemap.
Why do some homepage links not appear in the sitemap?
Often they're utility pages, old campaigns, tag archives or pages the sitemap plugin skips. Sometimes that's fine. Sometimes it's a page you still want Google to find. The list is a hint, not a verdict.
Is this the same as the full CrawlCare scan?
No. This page is only about discovering and status-checking pages. The full free scan adds mobile and desktop speed, SEO basics, SSL and email security records, and emails you the report.
Checking plugins or PHP next? Try the WordPress plugin check or the PHP2Shell check. Or run the full free scan.