How Can I Check Which Website Pages Google Has Indexed?

Check a specific page with Google Search Console’s URL Inspection tool, and use the Page indexing report to understand broader indexed and excluded groups. A site: search can provide a quick sample, but it is not a complete or authoritative list. Focus on whether your important canonical pages are indexed, not whether every URL Google has encountered is green.

Build a short inventory of your homepage, core services, key locations, contact page and valuable guides. That gives the audit a business purpose.

Start with URL Inspection

Open the correct Search Console property and paste the full URL into the inspection bar. Include the exact protocol, hostname and path. The report shows information about Google’s indexed version of that URL.

Expand Page indexing to see discovery, crawl and canonical details. “URL is on Google” means the page is indexed and eligible to appear, but it does not guarantee that it appears for every search or in a prominent position. Google’s URL Inspection guide explains those qualifications.

Thinking about your own rebuild?

Tell us about your business, your current website and what you would like to improve. We will help you work out the next step.

Tell us about your project↗

Distinguish the indexed view from the live test

The default result describes information held in Google’s index from its last processing. The live test fetches the current page to check whether it appears accessible and indexable now.

A live test can pass while the indexed view still shows an older problem because Google has not recrawled the fix. It can also miss canonical or duplicate decisions made during full indexing. Use it to verify a correction, then request indexing where appropriate and wait for processing.

Record the last crawl date and the user-declared and Google-selected canonical. Those details often explain why the address you typed is not the version included in the index.

Use the Page indexing report for patterns

The Page indexing report groups URLs Google knows about into indexed and not-indexed reasons. It is useful for seeing trends such as increases in server errors, accidental noindex, duplicate pages or discovered URLs that have not been crawled.

Google’s Page indexing report documentation says its example lists can be limited and are not designed to investigate one specific URL. Use URL Inspection for that job.

Compare the report with your own canonical URL inventory. Google’s total can include parameter variations, obsolete addresses, redirects and duplicates that were never intended as standalone pages.

Decide which pages matter

Create a simple table containing:

• canonical URL;
• page purpose;
• business priority;
• included in sitemap;
• linked internally;
• inspection status;
• Google-selected canonical;
• last checked date;
• action owner.

Start with pages that help customers understand and contact the business. Do not spend hours chasing an indexed count while the main service page is missing.

Use a site: search carefully

Searching site:example.com can reveal a sample of results. Adding a distinctive phrase or full URL can help check an individual page. However, this operator is not guaranteed to list everything Google has indexed, and result ordering is not an SEO report.

Google’s own Page indexing guidance recommends URL Inspection for specific URLs. Treat search results as an observation, not your master inventory.

Do not estimate indexed page totals from the number displayed above ordinary search results. Those estimates can change and do not replace Search Console data.

Understand normal exclusions

Not every known URL should be indexed. Expected exclusions include:

• a permanent redirect to a replacement page;
• a duplicate whose canonical is another URL;
• a login, basket or account page marked noindex;
• a removed page returning 404 or 410;
• parameter URLs that duplicate a main category;
• staging or test routes kept out of public search.

Some URLs should stay out of the index. Check whether each page’s status matches its purpose.

Investigate “Crawled – currently not indexed”

Google fetched the page but did not select it for the index. Review whether it is substantially similar to another page, has a conflicting canonical, contains little unique information or looks like a soft error.

Check the rendered content, not only the source template. A JavaScript failure may leave Google with less information than the browser shows you.

Improve the page because it better serves a distinct user need, not merely to change the status label. Repeated crawl requests without a meaningful change are unlikely to solve the cause.

Investigate “Discovered – currently not indexed”

Google knows the URL but has not yet crawled it. Newness and crawl scheduling can be factors. Confirm that the page is linked from known content, included in a clean sitemap and served by a reliable host.

Large numbers of low-value parameter or filter URLs can distract from the canonical set. Reduce unnecessary crawlable variations and keep internal links focused.

If the page is important and new, run a live inspection and request indexing once. Google’s recrawl guidance notes that requests are limited and repeated submissions do not speed crawling.

Review duplicate and canonical messages

“Duplicate without user-selected canonical” means Google found similar versions without a clear preference. “Duplicate, Google chose different canonical” means your declared preference was not the version selected.

Inspect both URLs. Align permanent redirects, canonical tags, internal links and sitemap entries. Do not canonicalise genuinely distinct pages simply to make a report cleaner.

Google describes canonical signals in its canonicalisation documentation. Redirects and canonical annotations are strong signals, while sitemap inclusion is weaker.

Look for indexing directives and crawl blocks

An excluded-by-noindex page may be correct or accidental. Check both HTML meta tags and response headers. A content management system can apply the instruction through a global privacy setting, template or plugin.

A robots block prevents crawling but is not a reliable method of removal. Search Console may report a URL indexed despite robots blocking when Google knows it from links but cannot fetch content.

Use secure authentication for genuinely private pages. Search controls should not be treated as a privacy boundary.

Compare the sitemap with indexed pages

Your sitemap should list canonical URLs intended for search. Filter the Page indexing report by the submitted sitemap where available. That narrows the review to addresses you deliberately supplied.

Remove redirected and noindex URLs from the sitemap. Keep lastmod accurate rather than changing every date automatically. A sitemap helps discovery but does not guarantee inclusion.

When exclusions look unexpected, review what your XML sitemap contains and make sure it lists only canonical, indexable pages.

Check after a launch or redesign

Before launch, export the existing website’s important URLs and any pages receiving search traffic or links. After launch, inspect their redirect destinations and the new canonical pages.

Search visibility can fluctuate while Google recrawls a substantial change. Missing redirects, staging canonicals and accidental noindex instructions require immediate attention; ordinary processing time requires monitoring rather than frantic rewriting.

Read does redesigning a website affect SEO? for the risks and safeguards, and use how to redesign without losing Google rankings as a migration checklist.

What if pages were indexed and then vanished?

Compare Search Console dates with releases, domain changes, server incidents and manual actions. Inspect the exact URL and Google-selected canonical. Review whether it now redirects, errors, carries noindex or duplicates another page.

Our guide to why a website can disappear from Google provides a calm incident-response sequence.

Do not assume a ranking fall proves deindexing. A page can remain indexed while moving lower for particular queries. Check the inspection status and then the Performance report separately.

Export and prioritise findings

Search Console can export report data for further review. Group findings by template, reason and business importance. A hundred obsolete parameter URLs may need one system-level fix, while a missing revenue-generating service page deserves individual investigation.

Assign an owner and retest date. After a fix, use live inspection to confirm the current page, request indexing if suitable, and allow time for Google to process it.

A small-site monthly routine

1. Inspect the homepage and two main service pages.
2. Review changes in indexed and not-indexed totals.
3. Check new error or server-failure groups.
4. Confirm the sitemap was read successfully.
5. Review recently published pages.
6. Compare important URLs with Search performance data.
7. Record actions and avoid resubmitting unchanged pages.

For a stable small brochure site, a focused monthly review and post-release check is usually more useful than watching the count daily.

Common mistakes

• Treating the site: operator as a complete index database.
• Expecting every URL variation to be indexed.
• Confusing an indexed page with a high-ranking page.
• Checking the wrong Search Console property.
• Comparing HTTP, HTTPS, www and non-www as though they were identical.
• Ignoring the Google-selected canonical.
• Resubmitting without fixing the reported cause.
• Removing intentional noindex from private or low-value pages.

The technical SEO guide explains how these indexing signals fit with crawling, status codes, performance and structured data.

Frequently asked questions

How do I see every URL Google has indexed?

Search Console provides totals, categories and examples, not necessarily a downloadable list of every indexed URL. Maintain your own canonical inventory and inspect priority pages directly.

Why does Search Console say indexed when I cannot find the page?

Indexing makes a page eligible to appear; it does not guarantee appearance for a particular query, location or user. Search Console’s indexed status is the better technical evidence.

How quickly will a fixed status update?

Google must recrawl and reprocess the page. This may take days or weeks. The live test can confirm the current version sooner but is not the indexed verdict.

Should I remove every 404 from the report?

No. A 404 is correct for content that is gone with no replacement. Fix broken internal links and sitemap entries, and redirect only where a genuinely relevant replacement exists.

Audit the pages that matter

A useful index check connects Search Console evidence to a deliberate list of business pages. Understand exclusions, correct real errors and leave intentional duplicates or retired URLs alone.

Afterworks includes crawlability, redirects and index checks in replacement planning. Explore our website rebuild service or contact us if you need a clearer technical foundation.

• Google indexing
• Google Search Console
• URL Inspection
• website SEO
• index coverage