Check one product in URL Inspection first
Start with one product URL, not the whole site. Open Search Console, paste in the address of a missing product, and read the result. The URL Inspection tool tells you if Google has indexed the page, and if not, why. It can also run a live test on the page as it is today. Google says a site with fewer than 500 pages probably does not need the full Page indexing report. So for a small store, a site: search on Google plus URL Inspection on your best sellers is often enough.
What each Page indexing status means
| Status | What Google means | What you do |
|---|---|---|
| Crawled - currently not indexed | Google crawled the page but did not index it. It may be indexed later. | Make the page more useful. There is no need to resubmit it. |
| Discovered - currently not indexed | Google found the URL but has not crawled it yet, often to avoid overloading your site. | Link to it from category pages and keep it in your sitemap. |
| URL marked 'noindex' | Google saw a noindex rule and left the page out. | Remove the noindex tag or header. |
| Blocked by robots.txt | A rule in your robots.txt file stopped Google crawling the page. | Remove the rule if the page should rank. |
| Duplicate without user-selected canonical | Google chose another URL as the main version and will not show this one. | Add a canonical tag that points to the page you want. |
noindex and robots.txt do different jobs
A robots.txt file controls crawling. Google says it is not a way to keep a page out of search. A noindex tag does that job, but only if Google can crawl the page and see the tag. So if robots.txt blocks a page, Google never reads its noindex rule. For a store, the usual mistake runs the other way. A noindex tag left over from testing, or a rule that blocks your products folder, hides pages you want found. Run the live test in URL Inspection. It shows if indexing is allowed right now.
Thin and duplicate product pages
Duplicate pages are one of the common reasons Google gives for pages left out. Picture one cotton kurti sold in six colours, each on its own URL with the same supplier text. Or a category page that makes a new URL for every filter, like color=green or sort=price. Google picks one version to show. You can steer that choice. Google treats a redirect and a canonical tag as strong signals, and a sitemap as a weak one. Then give each product you want ranked its own words and photos. Google says its systems favour high quality, useful content.
Keep every product in your sitemap
A sitemap is the list of URLs you want Google to find. Submit it in the Sitemaps report in Search Console, or add a Sitemap line to your robots.txt file. Either way, Google calls a sitemap a hint, not a promise. One sitemap can hold up to 50,000 URLs or 50MB, which covers almost any small catalogue. Keep it clean. List only live products you sell, not deleted items or old URLs. Then Google spends its visits on pages that matter to you.
Request indexing, step by step
- Inspect the product URL in Search Console.
- Click Test live URL to check the page as it is now.
- Fix what the test reports, such as a noindex tag or a robots.txt block.
- Click Request Indexing. You must be an owner or full user of the property.
- Wait. Google says crawling can take from a few days to a few weeks.
What requesting indexing will not do
Request Indexing asks Google to crawl a page. It does not make Google index it. There is a quota for single URLs, and Google says asking again for the same URL won't get it crawled any faster. For a whole catalogue, a sitemap is the better route. So fix the cause first, request once, then give it time. The Storemate handles the plumbing for you. It lists every active product in your sitemap, points its default robots.txt to that sitemap, sets a canonical URL on each product page, and adds a 301 redirect when you change a product's URL.