What belongs in a healthy sitemap

Include preferred, indexable URLs that return successful responses and represent content you want to appear in search. Usually that means canonical product, service, article and category pages rather than filtered duplicates, internal search results or retired pages.

Google treats sitemap inclusion as a discovery and canonicalization signal, not an indexing guarantee. A sitemap cannot compensate for inaccessible pages, weak internal links or content that does not satisfy search intent. Review your sitemap as one part of a broader indexability system.

Create an exportable inventory

Fetch the sitemap index and each child sitemap, then collect URL, sitemap source and lastmod into a spreadsheet. For each URL, request the final HTTP response, note redirect hops, inspect the canonical target and check for robots meta or X-Robots-Tag directives.

Add columns for indexability, current template, internal-link depth and whether the URL is still present in navigation or the content database. On a multilingual site, review language alternates and regional URL handling as a separate dimension. Keep the raw export so future audits can compare changes.

Identify the four most useful error groups

Group findings into redirecting URLs, non-200 responses, noncanonical URLs and noindex URLs. These are usually straightforward mismatches between the published sitemap and the site's intended search inventory. Separate temporary technical incidents from intentional exclusions.

For example, a migrated blog post may redirect to a consolidated guide while its old URL remains in a generated sitemap. Fix the generator to list the final canonical guide, confirm internal links use that destination and keep the redirect for users and historical links.

Use lastmod as evidence, not decoration

A meaningful lastmod value should reflect significant changes to the page's main content, structured data or links, not simply the date a sitewide footer changed. A publishing pipeline that stamps every page with today's date on each deployment makes the signal less useful.

Compare the value with actual article edits or CMS modification history. If the system cannot reliably identify meaningful changes, it is better to omit the optional value than fabricate freshness. Document what constitutes a significant update and which process writes the timestamp.

Validate sitemap structure and scale

Confirm XML is well formed, absolute URLs use the preferred protocol and host, and child sitemaps obey applicable limits. Google documents a maximum of 50,000 URLs or 50 MB uncompressed per sitemap; larger inventories need multiple files and often a sitemap index.

Check that a sitemap index references reachable child files and that your robots.txt points to the intended sitemap location when that is part of your setup. After changes, submit or inspect the sitemap in Search Console and review processing errors rather than assuming successful generation equals successful discovery.

Make the audit part of deployment QA

Compare sitemap URLs with the application route list and content records during each deployment. Flag newly published pages absent from the sitemap, removed pages still included, unexpected redirects and canonical disagreements. A simple automated diff often catches more useful errors than a quarterly manual spot check.

Prioritize business-critical pages first. A missing service page deserves attention before a low-value archive. When a URL is intentionally removed, document its redirect or 404/410 treatment and update internal links and sitemap membership together.

Measure whether the inventory is improving

Track the count of canonical 200 URLs, sitemap processing warnings, discovered-versus-indexed patterns and important pages missing from search. Do not treat total indexed pages as a growth target without judging their usefulness.

Connect this audit to the canonical URL guide, website migration checklist and content consolidation framework. A clean sitemap is a maintenance signal; strong content and navigable architecture are still what make the URLs worth discovering.