Crawl Errors Explained
Crawl errors can prevent search engines from reaching your pages. This guide explains what they are, why they matter, and how to address them.
Last updated: August 2026
What is crawling?
Crawling is how search engines discover pages on the web. Automated programs called crawlers follow links from one page to another, building a map of the internet.
What crawl errors mean
A crawl error happens when a search engine tries to reach a page but can't. This usually means the page won't appear in search results until the issue is resolved.
Common types of crawl errors
- 404 errors: a page was not found
- 5xx errors: the server failed to respond
- Redirect loops: pages redirect back and forth endlessly
- Blocked resources: files blocked from crawlers
- DNS errors: the domain can not be resolved
Typical distribution of crawl errors (illustrative)
- 404 errors
- 5xx errors
- Blocked resources
- Redirect loops
- DNS errors
Why they matter
When search engines can't reach your pages, those pages can't appear in search results. Persistent errors can also waste the limited time crawlers spend on your site.
How to find crawl errors
Google Search Console reports crawl errors for verified websites. InspectRank also reviews broken links and accessibility issues as part of its inspection.
How to fix them
- Fix or redirect broken internal links
- Restore deleted pages or redirect them to relevant alternatives
- Resolve redirect loops
- Check that important resources are not blocked
- Keep your server and DNS configuration healthy
Find out what may be holding your website back
Get a clear look at how your website communicates with potential customers, Google, local search and AI-powered platforms.
No credit card required · No sales call required