Preserve the failure's time and URL
Save the affected URL, reported fetch problem, and recorded crawl time. Also note when the owner first noticed the issue and whether visitors reported it. A vague statement that the site was down last week is less useful than a timestamped example. Keep the evidence before clearing caches or redeploying.
Source checks: Google Crawling Infrastructure: HTTP status codes · Google Search Console: Page indexing report · Google Search Console: URL Inspection
Look for a shared host or route pattern
Compare the homepage, affected service, and a lightweight public page. Ask the host for availability or application-error evidence near the reported time. Some faults affect only dynamic pages or a CMS dependency; others concern every request. Match the failure pattern with release times, resource limits, and upstream errors rather than assuming the search crawler caused the outage.
Repeat the actual requests deliberately
A transient issue can disappear during a live test. Record several observations at different times under comparable conditions, including final response status and displayed content. Do not create aggressive automated tests that add unnecessary load. Ask the technical owner to use appropriate monitoring and logs if the fault is not reproducible from a few ordinary requests.
Repair the cause and verify critical routes
Use a bounded incident note.
- Identify the failing server, dependency, or route before changing search metadata.
- Restore a successful public response for current service pages.
- Use an accurate temporary server response during real unavailability rather than a fake successful error page.
- Verify important inquiry routes after the repair.
- Retest the affected URLs and a healthy comparison under the same conditions.
- Save deployment time and monitoring evidence for follow-up.
Avoid misusing response codes as search controls
Server errors and overload signals can change crawler behavior and persistent faults can affect indexed URLs. Do not intentionally return errors to remove an unwanted page or imitate a temporary outage for marketing reasons. Use the appropriate content retirement or indexing decision instead. Likewise, changing a page title does not repair an unstable upstream service.
Review stability before interpreting recovery
Check whether new server errors stop appearing and whether repeated public tests remain healthy. Revisit the crawl evidence after the repair, comparing recorded dates with deployment. Keep search performance as a later observation, not a direct outage diagnosis. Positions and demand may change for other reasons even after availability is restored.
An incident summary should include what failed, which routes were affected, who repaired it, and what would trigger escalation again. For a small business, a clear contact person and exact failing examples are more useful than a promise that downtime cannot recur. Preserve the evidence so the next intermittent report starts with a known pattern.
Illustrative dynamic service request timing out
An illustrative site serves its static homepage normally, but three service pages periodically return 503 when their shared CMS request times out. Search Console's failed fetch timestamps coincide with host logs. The developer fixes the dependency and monitors those routes. The owner distinguishes stable responses after repair from any later change in organic clicks.
The incident log separates a 503 at the service route from a successful homepage request at the same time. That difference directs the reviewer toward the shared dynamic dependency rather than the domain's entire DNS configuration.
Different times explain different fetch results
Recorded crawl
Service returned 503
Current live test
Service returns 200
Host log comparison
Confirm transient dependency fault
After repair
Track repeated stable responses
Illustrative incident evidence needs timestamps and matching routes.
Your practical checklist
- Save a failing URL and recorded timestamp.
- Compare affected and lightweight healthy routes.
- Match errors with host logs and release history.
- Repeat ordinary tests without adding unnecessary load.
- Verify public content and inquiry behavior after repair.
- Track availability separately from search performance.
Your next action
Ask your host to compare one failed crawl timestamp with the corresponding application or availability logs.
Questions about this task
Why does my live test pass when Google recorded an error?
The two observations happened at different times. A transient fault can be absent now; compare timestamps and server evidence instead of discarding the older failure.
Should I change the content while fixing hosting?
Usually isolate the availability repair first. Changing copy, URLs, and hosting together makes it harder to identify what resolved the technical fault and can add new variables.
Sources and editorial notes
Prepared with AI-assisted research. Official sources are linked below; worked examples and checklists are Getting Found Local recommendations, not measured client outcomes.
Sources checked October 13, 2026. Platform interfaces and local resources may change; follow the current instructions on the linked official page.
- Google Crawling Infrastructure: HTTP status codes ↗
- Google Search Console: Page indexing report ↗
- Google Search Console: URL Inspection ↗
How we research, illustrate, and update these guides · Suggest a correction