{"id":2936,"date":"2012-08-24T05:43:28","date_gmt":"2012-08-24T09:43:28","guid":{"rendered":"http:\/\/www.mccordweb.com\/weblogs\/?p=2936"},"modified":"2012-08-18T09:01:31","modified_gmt":"2012-08-18T13:01:31","slug":"errors-google-reports-about-your-website-crawl-explained","status":"publish","type":"post","link":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/","title":{"rendered":"Errors Google Reports About Your Website Crawl Explained"},"content":{"rendered":"<p>Michael Wyszomierski of the Google Search Quality Team talks about errors that Google will report to you in the Webmaster Control Panel about the crawl and indexing of your website.<\/p>\n<p><iframe loading=\"lazy\" src=\"http:\/\/www.youtube.com\/embed\/tH1gQoCd05g\" frameborder=\"0\" width=\"560\" height=\"315\"><\/iframe><\/p>\n<p><strong>My Comments<\/strong><\/p>\n<p>There are two types of crawl errors they are site errors and specific URL errors.<\/p>\n<p>Site errors means that the Googlebot cannot access your website and are usually from an item listed in your robots.txt file. You should give these errors top priority for fast resolution.<\/p>\n<p>The most common URL is a &#8220;not found&#8221; error. This means that a page may be missing from your site or the URL changed and your sitemap.xml file should be updated to remove the triggering of these error messages.<\/p>\n<p>Having specific URL errors on your site is completely natural and nothing to worry about, but best practices should include a review and clean up periodically of these problems.<\/p>\n<p>The crawl errors are more important. Although a crawl error can be caused when your server is not available due to a glitch or network error, they should be investigated to make sure that your site is not blocking the crawl by search engine robots. You may even need to get with your web host if server errors happen frequently.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Michael Wyszomierski of the Google Search Quality Team talks about errors that Google will report to you in the Webmaster Control Panel about the crawl and indexing of your website. My Comments There are two types of crawl errors they are site errors and specific URL errors. Site errors means that the Googlebot cannot access your website and are usually from an item listed in your robots.txt file. You should give these errors top priority for fast resolution. The most common URL is a &#8220;not found&#8221; error. This means that a page may be missing from your site or the URL changed and your sitemap.xml file should be updated to remove the triggering of these error messages. Having specific URL errors on your site is completely natural and nothing to worry about, but best practices should include a review and clean up periodically of these problems. The crawl errors are more important. Although a crawl error can be caused when your server is not available due to a glitch or network error, they should be investigated to make sure that your site is not blocking the crawl by search engine robots. You may even need to get with your web host if server errors happen frequently. &nbsp; &nbsp;<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[35],"tags":[375],"class_list":["post-2936","post","type-post","status-publish","format-standard","hentry","category-google","tag-google-webmaster"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Errors Google Reports About Your Website Crawl Explained | The Web Authority<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Errors Google Reports About Your Website Crawl Explained | The Web Authority\" \/>\n<meta property=\"og:description\" content=\"Michael Wyszomierski of the Google Search Quality Team talks about errors that Google will report to you in the Webmaster Control Panel about the crawl and indexing of your website. My Comments There are two types of crawl errors they are site errors and specific URL errors. Site errors means that the Googlebot cannot access your website and are usually from an item listed in your robots.txt file. You should give these errors top priority for fast resolution. The most common URL is a &#8220;not found&#8221; error. This means that a page may be missing from your site or the URL changed and your sitemap.xml file should be updated to remove the triggering of these error messages. Having specific URL errors on your site is completely natural and nothing to worry about, but best practices should include a review and clean up periodically of these problems. The crawl errors are more important. Although a crawl error can be caused when your server is not available due to a glitch or network error, they should be investigated to make sure that your site is not blocking the crawl by search engine robots. You may even need to get with your web host if server errors happen frequently. &nbsp; &nbsp;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/\" \/>\n<meta property=\"og:site_name\" content=\"The Web Authority\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/mccordweb\" \/>\n<meta property=\"article:published_time\" content=\"2012-08-24T09:43:28+00:00\" \/>\n<meta name=\"author\" content=\"Nancy McCord\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@mccordweb\" \/>\n<meta name=\"twitter:site\" content=\"@mccordweb\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nancy McCord\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/\"},\"author\":{\"name\":\"Nancy McCord\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#\\\/schema\\\/person\\\/7499f3ac0b008bc0e5b7a138ac1dc0ba\"},\"headline\":\"Errors Google Reports About Your Website Crawl Explained\",\"datePublished\":\"2012-08-24T09:43:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/\"},\"wordCount\":218,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#organization\"},\"keywords\":[\"Google Webmaster\"],\"articleSection\":[\"Google\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/\",\"url\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/\",\"name\":\"Errors Google Reports About Your Website Crawl Explained | The Web Authority\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#website\"},\"datePublished\":\"2012-08-24T09:43:28+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/2012\\\/08\\\/24\\\/errors-google-reports-about-your-website-crawl-explained\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Errors Google Reports About Your Website Crawl Explained\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#website\",\"url\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/\",\"name\":\"The Web Authority | McCord Web Services News\\\/Blog\",\"description\":\"Smart Digital Marketing, Real Business Results - McCord Web Services\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#organization\",\"name\":\"McCord Web Services LLC\",\"url\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/McCord-Web-White-logo.png\",\"contentUrl\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/McCord-Web-White-logo.png\",\"width\":450,\"height\":203,\"caption\":\"McCord Web Services LLC\"},\"image\":{\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/mccordweb\",\"https:\\\/\\\/x.com\\\/mccordweb\",\"https:\\\/\\\/www.instagram.com\\\/nancy_mccord\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/nancymccord\",\"https:\\\/\\\/www.youtube.com\\\/user\\\/mccordweb\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.mccordweb.com\\\/weblogs\\\/#\\\/schema\\\/person\\\/7499f3ac0b008bc0e5b7a138ac1dc0ba\",\"name\":\"Nancy McCord\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/84f303fb7bc8bf9e3aa944d8a2b0913642ca2c0cb4e244d9bbea83c59dac189e?s=96&d=blank&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/84f303fb7bc8bf9e3aa944d8a2b0913642ca2c0cb4e244d9bbea83c59dac189e?s=96&d=blank&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/84f303fb7bc8bf9e3aa944d8a2b0913642ca2c0cb4e244d9bbea83c59dac189e?s=96&d=blank&r=g\",\"caption\":\"Nancy McCord\"},\"sameAs\":[\"http:\\\/\\\/www.mccordweb.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Errors Google Reports About Your Website Crawl Explained | The Web Authority","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/","og_locale":"en_US","og_type":"article","og_title":"Errors Google Reports About Your Website Crawl Explained | The Web Authority","og_description":"Michael Wyszomierski of the Google Search Quality Team talks about errors that Google will report to you in the Webmaster Control Panel about the crawl and indexing of your website. My Comments There are two types of crawl errors they are site errors and specific URL errors. Site errors means that the Googlebot cannot access your website and are usually from an item listed in your robots.txt file. You should give these errors top priority for fast resolution. The most common URL is a &#8220;not found&#8221; error. This means that a page may be missing from your site or the URL changed and your sitemap.xml file should be updated to remove the triggering of these error messages. Having specific URL errors on your site is completely natural and nothing to worry about, but best practices should include a review and clean up periodically of these problems. The crawl errors are more important. Although a crawl error can be caused when your server is not available due to a glitch or network error, they should be investigated to make sure that your site is not blocking the crawl by search engine robots. You may even need to get with your web host if server errors happen frequently. &nbsp; &nbsp;","og_url":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/","og_site_name":"The Web Authority","article_publisher":"https:\/\/www.facebook.com\/mccordweb","article_published_time":"2012-08-24T09:43:28+00:00","author":"Nancy McCord","twitter_card":"summary_large_image","twitter_creator":"@mccordweb","twitter_site":"@mccordweb","twitter_misc":{"Written by":"Nancy McCord","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/#article","isPartOf":{"@id":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/"},"author":{"name":"Nancy McCord","@id":"https:\/\/www.mccordweb.com\/weblogs\/#\/schema\/person\/7499f3ac0b008bc0e5b7a138ac1dc0ba"},"headline":"Errors Google Reports About Your Website Crawl Explained","datePublished":"2012-08-24T09:43:28+00:00","mainEntityOfPage":{"@id":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/"},"wordCount":218,"commentCount":0,"publisher":{"@id":"https:\/\/www.mccordweb.com\/weblogs\/#organization"},"keywords":["Google Webmaster"],"articleSection":["Google"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/","url":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/","name":"Errors Google Reports About Your Website Crawl Explained | The Web Authority","isPartOf":{"@id":"https:\/\/www.mccordweb.com\/weblogs\/#website"},"datePublished":"2012-08-24T09:43:28+00:00","breadcrumb":{"@id":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.mccordweb.com\/weblogs\/2012\/08\/24\/errors-google-reports-about-your-website-crawl-explained\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.mccordweb.com\/weblogs\/"},{"@type":"ListItem","position":2,"name":"Errors Google Reports About Your Website Crawl Explained"}]},{"@type":"WebSite","@id":"https:\/\/www.mccordweb.com\/weblogs\/#website","url":"https:\/\/www.mccordweb.com\/weblogs\/","name":"The Web Authority | McCord Web Services News\/Blog","description":"Smart Digital Marketing, Real Business Results - McCord Web Services","publisher":{"@id":"https:\/\/www.mccordweb.com\/weblogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.mccordweb.com\/weblogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.mccordweb.com\/weblogs\/#organization","name":"McCord Web Services LLC","url":"https:\/\/www.mccordweb.com\/weblogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.mccordweb.com\/weblogs\/#\/schema\/logo\/image\/","url":"https:\/\/www.mccordweb.com\/weblogs\/wp-content\/uploads\/2025\/09\/McCord-Web-White-logo.png","contentUrl":"https:\/\/www.mccordweb.com\/weblogs\/wp-content\/uploads\/2025\/09\/McCord-Web-White-logo.png","width":450,"height":203,"caption":"McCord Web Services LLC"},"image":{"@id":"https:\/\/www.mccordweb.com\/weblogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/mccordweb","https:\/\/x.com\/mccordweb","https:\/\/www.instagram.com\/nancy_mccord\/","https:\/\/www.linkedin.com\/in\/nancymccord","https:\/\/www.youtube.com\/user\/mccordweb"]},{"@type":"Person","@id":"https:\/\/www.mccordweb.com\/weblogs\/#\/schema\/person\/7499f3ac0b008bc0e5b7a138ac1dc0ba","name":"Nancy McCord","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/84f303fb7bc8bf9e3aa944d8a2b0913642ca2c0cb4e244d9bbea83c59dac189e?s=96&d=blank&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/84f303fb7bc8bf9e3aa944d8a2b0913642ca2c0cb4e244d9bbea83c59dac189e?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/84f303fb7bc8bf9e3aa944d8a2b0913642ca2c0cb4e244d9bbea83c59dac189e?s=96&d=blank&r=g","caption":"Nancy McCord"},"sameAs":["http:\/\/www.mccordweb.com"]}]}},"_links":{"self":[{"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/posts\/2936","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/comments?post=2936"}],"version-history":[{"count":1,"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/posts\/2936\/revisions"}],"predecessor-version":[{"id":2937,"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/posts\/2936\/revisions\/2937"}],"wp:attachment":[{"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/media?parent=2936"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/categories?post=2936"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.mccordweb.com\/weblogs\/wp-json\/wp\/v2\/tags?post=2936"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}