Googlebot Crawl Patterns in Google Panda Affected Sites

We got stuck by Google Panda update recently and was reviewing the Googlebot crawl stats for our site on Webmaster tools. We observed this new pattern of Googlebot crawls ever since Panda struck and wiped out our search engine traffic significantly.

Presumably it was due to the new Google Algorithm which penalized sites with heavy ads above-the-fold, which might have been the cause, but there are no recovery signs yet. Traffic continues to drop and we continue to bring you latest Panda updates.

Googlebot Crawl Patterns

View these charts from the last 90 days. Google Panda struck around Late January.

Pages crawled per day


If you observe carefully you note that there is no change in pages crawled per day, so Googlebot continue to effectively crawl all webpages (though we have deleted nearly 1000 pages of thin content!).

Time spent downloading a page

googlebot crawl

Time spent downloading a page is also same as before, which is actually not same as site speed time (as we have made our site faster by 100% since then), as Googlebot fetches the site code and is not bothered with loading scripts etc.

Kilobytes downloaded per day

googlebot panda traffic

What has changed is Kilobytes downloaded per day, which has significantly reduced since the day Panda struck. So effectively Googlebot is now downloading less than half of what it used to download earlier.  Also note the weekly pattern is not regular as it was earlier. And the irregular pattern increased a few weeks before Panda striked the site.

If Google Panda crashed your site traffic, do you notice a similar Googlebot pattern? How do you interpret these charts?


  1. Sagar says:

    Yes somewhat the same, Panda hit my blog on 19th January and I still cannot see any major improvement in traffic.

  2. ramjna says:

    As said on google blog they will implement 500 updates. its changing algorithm rapidly. Panda update is one of them.. Oh my god. Google changing in great way. Quality content will rock in this case.

  3. Chris Trynkiewicz says:

    I was struck as well by the layout algorithm change, although I don’t see such changes in this chart. I must admit though, that I have only like 6KB average downloads per day by the googlebot, so it may not be visible. Please keep us updated if anything changes in your traffic. My still declines, now it’s 30% of what it used to be :(

  4. MaxKovat says:

    In fact, I think it is only for the best!

    I have no idea how your site looked before; however, right now it has a simple design, no unnecessary “shiny” plugins etc. I find the content fast and don’t have to wait for the page to load.

    Keep it this way and your traffic will surely come back :)

  5. thejas kamath says:

    Last time when I had created Google indexed my blog very fast. But this time Google is taking much time to crawl. Is this because of the new algorithm Google has implemented???

    • Martin says:

      it just happens. Sometimes Googlebot needs much time to crawl your page. Of course there are maybe problem with an internal linking of your blog.

  6. Piotr Bydlowski says:

    “Is this because of the new algorithm Google has implemented???”
    More or less :)

Leave a Reply

Your email address will not be published. Required fields are marked *