{"id":25358,"date":"2012-03-20T19:53:09","date_gmt":"2012-03-20T14:23:09","guid":{"rendered":"https:\/\/www.quickonlinetips.com\/archives\/?p=25358"},"modified":"2020-05-24T10:58:06","modified_gmt":"2020-05-24T05:28:06","slug":"panda-googlebot-crawl-patterns","status":"publish","type":"post","link":"https:\/\/www.quickonlinetips.com\/archives\/2012\/03\/panda-googlebot-crawl-patterns\/","title":{"rendered":"Googlebot Crawl Patterns in Google Panda Affected Sites"},"content":{"rendered":"

We got stuck by Google Panda<\/a> update recently and was reviewing the Googlebot crawl stats for our site on Webmaster tools. We observed this new pattern of Googlebot crawls ever since Panda struck and wiped out our search engine traffic significantly.<\/p>\n

Presumably it was due to the new Google Algorithm which penalized sites with heavy ads above-the-fold<\/a>, which might have been the cause, but there are no recovery signs yet. Traffic continues to drop and we continue to bring you latest Panda updates.<\/p>\n

Googlebot Crawl Patterns<\/h3>\n

View these charts from the last 90 days. Google Panda struck around Late January.<\/p>\n

Pages crawled per day<\/strong><\/p>\n

\"googlebot-crawl\"<\/p>\n

If you observe carefully you note that there is no change in\u00a0pages crawled per day, so Googlebot continue to effectively crawl all webpages (though we have deleted nearly 1000 pages of\u00a0thin content<\/a>!).<\/p>\n

Time spent downloading a page<\/strong><\/p>\n

\"googlebot<\/p>\n

Time spent downloading a page is also same as before, which is actually not same as site speed time (as we have made our\u00a0site faster<\/a> by 100% since then), as Googlebot fetches the site code and is not bothered with loading scripts etc.<\/p>\n

Kilobytes downloaded per day<\/strong><\/p>\n

\"googlebot<\/p>\n

What has changed is\u00a0Kilobytes downloaded per day, which has significantly reduced since the day Panda struck. So effectively Googlebot is now downloading less than half of what it used to download earlier. \u00a0Also note the weekly pattern is not regular as it was earlier. And the irregular pattern increased a few weeks before Panda striked the site.<\/p>\n

If Google Panda crashed your site traffic, do you notice a similar Googlebot pattern? How do you interpret these charts?<\/p>\n","protected":false},"excerpt":{"rendered":"

We got stuck by Google Panda update recently and was reviewing the Googlebot crawl stats for our site on Webmaster…<\/p>\n","protected":false},"author":4,"featured_media":25363,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[6,3],"tags":[],"class_list":["post-25358","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blogging","category-google"],"_links":{"self":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/posts\/25358","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/comments?post=25358"}],"version-history":[{"count":0,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/posts\/25358\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/media\/25363"}],"wp:attachment":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/media?parent=25358"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/categories?post=25358"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/tags?post=25358"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}