/ โ† Site Audit Fixes / Search Console Errors Explained
In this guide
  1. What Search Console is telling you
  2. Which reports need action, and how urgently
  3. The Page indexing report, status by status
  4. Checking an issue from the command line
  5. The other reports in plain terms
  6. A worked example
  7. The fix, step by step
  8. Edge cases worth knowing
  9. Keeping on top of it
  10. Questions and answers

What Search Console is telling you

Google Search Console reports what Googlebot found when it crawled your site, what it chose to index, and how your pages appear in results. Most of what it shows is information, not error. A site with a few hundred pages will nearly always have some URLs listed as not indexed, some structured data warnings and some pages in a Need improvement group. That is normal. The skill is telling the handful of issues that cost you traffic apart from the many that do not.

The reports sit in the left-hand menu in four main areas:

The URL Inspection tool at the top of every screen sits alongside all of these. It shows what Google knows about one URL, and its Test live URL button fetches the page as Googlebot would now.

๐Ÿ’ก Older guides mention the Mobile Usability and Page Experience reports. Google retired both, so if you cannot find them, nothing is wrong with your account.

Which reports need action, and how urgently

ReportWhat it coversAct when you seeUrgency
Manual actionsPenalties applied by a Google reviewer for breaking spam policiesAny entry at allImmediate
Security issuesHacked content, malware, deceptive pagesAny entry at allImmediate
Pages (Page indexing)Which URLs are indexed and why the rest are notServer errors, redirect errors, soft 404s, noindex or robots.txt blocks on pages you want foundHigh for important pages
SitemapsWhether each submitted sitemap can be readCouldn't fetch, Has errors, or many listed URLs not indexedMedium
Core Web VitalsReal-visitor speed and stability, grouped by URLGroups marked Poor on mobileMedium
HTTPSPages not served securelyAny URL you want indexed appearing as non-HTTPSMedium
EnhancementsStructured data errors and warningsInvalid items on pages where you want a rich resultLow to medium

Two questions decide whether any issue matters: does it affect a page you want in search results, and is the number growing? A redirect error on a retired campaign page does not matter. A server error on your best-selling product does.

The Page indexing report, status by status

The Pages report splits URLs into indexed and not indexed, then lists a reason for every URL that is not indexed. Google calls each reason an issue, but many describe correct behaviour.

Reason shownUsually meansAction
Server error (5xx)Your server failed when Googlebot askedFix: see server errors in Search Console
Redirect errorA loop, a long chain or a redirect to a bad URLFix: see page with redirect and redirect error
Soft 404The page returns 200 but looks empty or like an error pageAdd real content or return a true 404 or 410
Excluded by noindex tagThe page asks not to be indexedFix only if the tag is a mistake: see excluded by noindex tag
Blocked by robots.txtGooglebot is not allowed to crawl itFix only if the block is a mistake
Crawled, currently not indexedGoogle fetched it and chose not to index it yetImprove or merge thin pages: see crawled, currently not indexed
Discovered, currently not indexedGoogle knows the URL but has not crawled it yetStrengthen internal links; check server capacity
Alternate page with proper canonical tagA duplicate correctly pointing at its main versionNone: see alternate page with proper canonical tag
Page with redirectThe URL redirects elsewhereNone, unless it is a page you want indexed
Not found (404)The page does not existNone for deleted pages; redirect if it had links or traffic
Duplicate, Google chose different canonical than userGoogle disagrees with your canonical tagCheck the pages really are duplicates

Open any reason to see example URLs and a chart over time. The chart matters more than the total. A steady count of alternate pages is fine. A sudden jump in server errors after a hosting change is not.

Checking an issue from the command line

Before changing anything, confirm what Googlebot sees. Export the example URLs from the report with the Export button, save them as urls.txt, then check the status code and final address of each:

while read -r url; do
  curl -s -o /dev/null -A "Googlebot" -w "%{http_code} %{num_redirects} %{url_effective}  $url\n" -L "$url"
done < urls.txt

Each line shows the final status code, how many redirects were followed and where the URL ended up. Server errors show as 5xx, redirect problems show as a high redirect count or a final 4xx, and soft 404 candidates return 200 with a very small page.

To check for a stray noindex, look at both the HTML and the headers:

curl -sI https://www.example.com/page/ | grep -i x-robots-tag
curl -s https://www.example.com/page/ | grep -io '<meta[^>]*robots[^>]*>'

For a sitemap marked Couldn't fetch, check it loads, returns 200 and is real XML:

curl -sI https://www.example.com/sitemap.xml | head -n 5
curl -s https://www.example.com/sitemap.xml | head -c 300

If the sitemap returns HTML, a login page or a 404, fix that first. The sitemap could not be read guide covers the common causes.

Then use URL Inspection on one example and run Test live URL. If the live test passes but the report still shows the issue, the report is simply out of date and will update after the next crawl.

The other reports in plain terms

Sitemaps

Each submitted sitemap shows a status and a count of discovered URLs. Success means Google read it. A sitemap listing thousands of URLs that are not indexed suggests it includes redirected, noindexed or duplicate pages; it should list only the canonical URLs you want indexed.

Core Web Vitals

URLs are grouped by how real visitors experienced them, for mobile and desktop separately. Fix groups marked Poor first, one template at a time. See Core Web Vitals assessment failed.

HTTPS

Lists URLs Google found that are not served over https. Each should redirect to its https version, or be fixed so it loads securely with a valid certificate.

Enhancements

Each structured data type gets its own report with invalid and valid items. Critical issues make a page ineligible for that rich result. Non-critical issues only mean optional properties are missing, and the page can still show the result. See structured data syntax errors and breadcrumb structured data issues.

Manual actions and Security issues

A manual action means a person at Google found a breach of the spam policies, such as unnatural links or thin, copied content. A security issue means Google detected hacked pages, malware or deceptive content. Both can remove pages from results or add warnings. Fix the cause fully, then use Request review and explain what you changed.

โš ๏ธ If a security issue appears, change all passwords, update the CMS, themes and plugins, and remove unknown admin users before requesting a review. A review requested while the hole is still open usually fails.

A worked example

A site owner logs in and sees 3,000 pages not indexed against 900 indexed. It looks alarming. Opening the Pages report shows:

The server errors are fixed first by caching the search template and blocking crawl of internal search result URLs in robots.txt. Validation is started. The thin tag archives are set to noindex and the short variants merged into their parent products. The alternate pages and redirects are left alone, because they are doing their job. Two months later the not indexed total is still high, but every page the business wants found is indexed.

The fix, step by step

Step 1

Check Manual actions and Security issues

Open Security and Manual actions in the left menu and read both reports. If either says no issues detected, move on. If there is an entry, stop and deal with it before anything else, because it can remove pages from results. Read the description and example URLs, fix the cause completely, then press Request review and explain what you changed. Confirm success when the report later shows the issue as resolved.

Step 2

Open the Page indexing report

Go to Indexing, then Pages, and scroll to the list of reasons why pages are not indexed. Sort the reasons into two groups: those needing action, such as Server error (5xx), Redirect error, Soft 404 or an unexpected noindex, and those that describe correct behaviour, such as alternate pages with a proper canonical tag. Write down the count for each actionable reason so you can measure progress later.

Step 3

Confirm each issue with a live test

Open an actionable reason, pick an example URL that matters to you and run URL Inspection, then Test live URL. Compare the result with a curl -I request from your own machine. If the live test is clean, the report is out of date and will clear after the next crawl. If the live test shows the same problem, you have confirmed a real fault and found the URL pattern to fix.

Step 4

Fix server and redirect errors first

Server errors and redirect errors stop Google reading pages at all, so they come before anything else. Check your server error log for the times Googlebot visited, raise limits or add caching on templates that time out, and correct redirect loops or chains so each old URL goes to its final address in one step. Confirm by running the curl loop over the exported URLs and seeing 200 or a single 301 for each.

Step 5

Correct accidental blocks

For pages you want indexed that show Excluded by noindex tag or Blocked by robots.txt, find where the block comes from. Check the meta robots tag, the X-Robots-Tag header, SEO plugin settings and the robots.txt file. Remove the block for those pages only, leaving intended blocks on admin, basket and search pages in place. Confirm with a live test that the page is now crawlable and indexable.

Step 6

Check sitemaps and HTTPS

Open the Sitemaps report and confirm each sitemap shows Success. If one shows Couldn't fetch or Has errors, load it in a browser and with curl to check it returns 200 and valid XML. Make sure it lists only canonical, indexable URLs. Then open the HTTPS report and check that any http URLs listed redirect to their https versions with a single permanent redirect.

Step 7

Work through Core Web Vitals and Enhancements

Open Core Web Vitals and note any group marked Poor on mobile, then fix the template behind it. Open each Enhancements report and look at invalid items first, since critical issues stop the page being eligible for that rich result. Non-critical issues can wait. Fix the markup in the template that produces it and test one example in the Rich Results Test before moving on.

Step 8

Validate each fix and record it

When a fix is live on every affected URL, open the issue in its report and press Validate fix. Google rechecks the listed URLs over the following days or weeks and moves the status through Started and Looking good to Passed or Failed. Record the date and what you changed. If validation fails, open the URLs that still fail, look for a different cause, fix it and validate again.

Edge cases worth knowing

Keeping on top of it

Search Console rewards a regular, short routine more than an occasional long one:

  1. Every week: check Manual actions and Security issues, and glance at the Pages chart for sudden jumps.
  2. Every month: review Page indexing, Sitemaps and Core Web Vitals, and open any issue whose count is rising.
  3. After any release that changes templates, URLs, hosting or plugins: inspect a few key URLs with the live test and watch the reports for the next two weeks.
  4. Keep notifications reaching you: make sure the owner and full users have a current email address under Settings, Users and permissions, because Google emails them about new issues.

For a wider check of the same problems across your whole site, the site audit guide explains how a crawl finds them before Google reports them.

Questions and answers

1. Which Search Console errors should I fix first?

Fix manual actions and security issues first, because they can remove pages from results or show warnings to searchers. After those, fix server errors, redirect errors, soft 404s and accidental noindex or robots.txt blocks on pages you want indexed, because they stop Google reading or indexing those pages. Core Web Vitals groups marked Poor come next, then structured data errors on pages where you want a rich result. Statuses that describe correct behaviour, such as alternate pages with a proper canonical tag, need no action.

2. Is it bad to have lots of pages not indexed in Search Console?

No, a large number of pages not indexed is normal for most sites and is not a problem in itself. The total includes redirected URLs, duplicates pointing at their main version, deleted pages, filtered shop URLs and pages you have chosen to keep out. What matters is whether pages you want found are among them. Open each reason, check the example URLs and act only on the ones that are important pages excluded by mistake or by a fault.

3. What is the difference between an error and a warning in Search Console?

In the structured data reports, an error, shown as a critical issue, makes the page ineligible for that rich result, while a warning, shown as a non-critical issue, only means an optional property is missing. A page with warnings can still show the rich result. In the Page indexing report there is no error or warning split; each reason simply explains why a URL is not indexed, and only some of those reasons point to a real fault on your site.

4. How long does Validate fix take in Search Console?

Validation usually takes from a few days to about two weeks, and it can take longer for large groups of URLs or for the Core Web Vitals report, which watches real-visitor data over 28 days. Google rechecks the affected URLs and shows the progress as Started, then Looking good, then Passed or Failed. You receive an email when it finishes. Starting validation does not speed up crawling of the rest of your site; it only tracks the URLs in that issue.

5. Why does Search Console still show an error I have already fixed?

Search Console reports what Google saw when it last crawled each URL, so an error stays listed until Googlebot visits the page again. That can take days or weeks for less important pages. Use URL Inspection and run a live test to confirm the fix works now. Then start validation on the issue, which asks Google to recheck the affected URLs. If the live test still shows the error, the fix has not reached the page Google is reading.

6. What does a manual action mean, and how do I remove it?

A manual action means a person at Google reviewed your site and found it breaks Google's spam policies, for example through unnatural links, copied or auto-generated thin content, or hidden text. Affected pages or the whole site may rank lower or be removed. To remove it, read the description in the Manual actions report, fix every instance of the problem, document what you did, then press Request review and explain the changes clearly. Reviews can take several weeks.

7. Do I need to fix every structured data warning?

No, you do not need to fix every structured data warning. Warnings, shown as non-critical issues, mean optional properties are missing, and the page stays eligible for the rich result. Add the missing properties only when you have accurate information to put in them, such as a real brand or a genuine image. Never add made-up values just to clear a warning. Critical issues are different: they stop the rich result appearing, so fix those on pages where it matters.

Find Search Console issues before Google does

The site audit crawls your pages the way a search engine does and flags server errors, redirect problems, stray noindex tags and broken sitemaps, so you can fix them before they show up in Search Console.

Open Site Audit Fixes โ†’
๐Ÿ’ฌ Got a problem?
Related Guides: All Site Audit Fixes  ·  Search Console Server Error (5xx)  ·  Page With Redirect and Redirect Error  ·  Crawled, Currently Not Indexed  ·  Excluded by Noindex Tag  ·  Learning Hub

About aiwebpageseo

aiwebpageseo.com is a data-driven SEO and AEO (Answer Engine Optimisation) platform providing a free suite of technical SEO tools. Rather than relying on AI-theorised assumptions, the platform analyses live URL performance, delivering objective diagnostics, page speed metrics, CLS debugging, and site crawl data alongside actionable technical tutorials.