Google PlusFacebook iconTwitter icon+44 113 260 4010 contact@branded3.com

Blogstorm »

Has Google Stopped Indexing Blogs?

This might seem an overly dramatic headline but it seems that Google is having trouble indexing certain WordPress blogs.

DaveN spotted the issue first when he realised his new blog posts were missing from the Google search index even though Google had spidered them and included them in the blog search results.

In what might be a related issue Google has been alerting people (myself included on 2 WordPress blogs) to “General HTTP Errors” in the Webmaster Tools console.

As far as I can tell from looking at crawl logs Google accessed these pages just fine so why are the errors appearing and what are they?

BY Patrick Altoft AT 2:55pm ON Monday, 15 September 2008

Patrick Altoft is Director of Search at Branded3 and has worked in the SEO industry for over 10 years. With experience across some of the worlds largest brands as well as startup businesses Patrick is well known in the industry and speaks regularly at the major SEO conferences and events. Follow Patrick on Twitter or Google+

Comments

  • http://www.distilled.co.uk/blog/ Tom

    I’m getting general HTTP errors in my WMC for distilled too – though I’m actually seeing it for some regular HTML pages as well as individual blog posts

  • http://www.seo-scoop.com DazzlinDonna

    Yep, I have those same errors for SEO Scoop as well. I’m guessing it’s a reporting glitch, but maybe it’s an actual problem. Hope G either fixes – or tells us more.

  • http://www.internetbusinessblogger.com Internet Business Blogger

    I just went into webmaster tools and get the same thing. Some of the posts though are older posts so I am not sure what the problem is. I was worried about the links themselves so I clicked through and they are there.

    Anyway, I created a post on the weekend that should have ranked very high for “Huricane Ike Cancun” looked the next day and I was not in the first 30 results so I am apt to agree with you about the indexing of new blog posts.

    Hopefully this is just an error on Googles side

  • http://www.seopscentre.com Ken Jones

    I noticed the same thing on my WM Tools report a couple of days ago, but just assumed it was a temporary glitch because the date of the error coincided with the day last week when I installed the latest WP update. I put up a new post later that day and G’s cache of my homepage shows that post (and a cache time that’s only a couple of minutes after I hit the publish button) so it all seemed hunky-dory after that.
    Haven’t had any other crawl errors reported, but if it’s affecting a lot of other WP users as well it might be something more serious. I’ll have to have a deeper look into my stats and see if it shows up anything untoward.

  • http://www.joshuasciarrino.com Joshua Sciarrino (schreno)

    Actually, I’d say it’s your reports that are in error.

    Blogstorm looks fine.
    Dave Naylor looks fine.
    DazzlinDonna looks fine.

    Everything is okay. Just another glitch in google’s products. ;)

  • http://www.imnotadoctor.com imnotadoctor

    I am having this issue as well on my wordpress blog. How odd.

  • http://blog.80percentmental.com Dan

    Conspiracy alert!! Only issues with WP and not Blogger sites? Hmmmm….

  • http://www.sciencebase.com David Bradley

    I can see half a dozen of those general http errors for my site all dated September 9, I suspect it’s a transient error, but more to the point all the pages in question are #1 in the Google SERP for their titles

  • Pingback: Have You Got Your Free Backlinks From Yahoo Yet? | Brad Blogging

  • http://pyrmontvillage.com.au/ don

    Interesting. I was having similar issues and thought, it was my developer’s fault.
    And like Dave above, those particular titles were in number one slots.

    In my case I have been using wordpress as a CMS. Maybe its time to abandon ship and go over to DRUPAL.

  • http://www.thegreenbabyspot.com Jenin

    I seem to be having a similar problem and I’m really frustrated. Since the 9th of September it appears that google has stopped indexing my new blog posts. I don’t know what to do about this. At first I thought it was a problem with my blog, but I realise that others are facing a similar problem. Any news on whether Google has acknowledged this problem or made any announcements about how it will be solved??

  • http://bradblogging.com Brad Blogging.com – Personal Blog Tips And Blog Help

    I hardly think that Google is going to stop indexing blogs..

    They are accounting for more internet content than any other type of media on the internet. I’m sure it’s just something like a feedburner glitch and will be over soon. :)

  • http://www.searchengineoptimization.com Nick Stamoulis

    Good to hear it’s probably just a tool error as opposed Google not indexing them anymore..phew!

  • http://techathand.net Dexter | Tech At Hand Dot Net

    I also have the same errors in my Log

  • Pingback: Google is Creating Problem with SEO Blogs ? | Tech At Hand Dot Net | Philippines, Technology, SEO and Blogging

  • http://www.sciencebase.com David Bradley

    I see the errors for another of my sites that isn’t strictly speaking a blog and doesn’t run WordPress

  • http://s.billard.free.fr/referencement/ Sébastien Billard

    Got the same generic HTTP errors and I use Dotclear. Google is also very slow to refresh the index pages which is unusual as my blog has some decent popularity.

  • http://www.navycs.com/blogs/ Tom Goering

    My blog stopped having pages indexed in Google Blog Search the day I was excepted for AdSense for Feeds. Blog Search updates from the site’s feed.

    My posts however do make it to the regular index on Googlebots regular rounds.

    I deactivated Feedsmith in wordpress and everything is back to normal (except the benefits of feedsmith that is)

  • http://www.seo-scoop.com DazzlinDonna

    I’ve made this comment elsewhere, but I think it deserves to be shared here as well: One seorefugee member found his blog indexing issue to be related to the switch to adsense for feedburner. (see http://www.seorefugee.com/forums/showthread.php?t=10624) Perhaps this will help at least some folks track down their problems.

  • http://johnmu.com/ JohnMu

    Hi Patrick, the “General HTTP Errors” should be disappearing from your account soon — it seems that this was an intermittent reporting issue in Webmaster Tools. It’s not an error you need to be worried about, sorry for the scare! If it doesn’t disappear from your account in the next day or so, it’d be great if you could post in the Webmaster Help groups at http://groups.google.com/group/Google_Webmaster_Help-Tools/browse_thread/thread/d40a45ed11f1534e/

  • http://holisticsearch.co.uk Peter Young

    Had the same with a number of wordpress blogs – both .com and hosted.

    Is the problem merely with WordPress blogs, or have any other blog vendors been affected?

  • http://www.beauty-salon-marketing.co.uk/ Jon

    I had one http error on 8th September, but have been OK since. I’m still on WP 2.5 – wonder if the version makes any difference?

    Cheers, Jon

  • http://www.sciencetext.com David Bradley

    Apparently, Google is now aware of this issue. To quote from JohnMu, who is presumably staff: “This appears to be an issue in the reporting side of things in
    Webmaster Tools. As far as I know, the “General HTTP errors” should be
    gone soon :-). Thanks for bringing it to our attention, you guys are
    the greatest!!”

    http://groups.google.com/group/Google_Webmaster_Help-Tools/browse_thread/thread/d40a45ed11f1534e#

  • http://www.onlinemarketingperformance.com Scott McAndrew

    I had several HTTP errors for both of the blogs I actively run last week. Google crawls one of the blogs immediately after posts are made and new posts generally go straight onto the blog search results with the web search results soon after. In the past few days I’ve noticed significantly more lag than I’d become accustomed to.

  • Pingback: The Weekly Insider 9-15-08 to 9-19-08

  • http://tvontheweb.blogspot.com Chris at Watch TV Shows Online

    I don’t know about that, but I do know that recently a site of mine took some severe drops in Google search engine results pages. So something is going on!

Feedburner Users

Tags

.Net AJAX Android apps Bing Branded3 C# CMS competwition conversion CSS development e-commerce email F# Facebook features Gmail Google HTML HTML5 IE9 interactive internet Internet World JavaScript Leeds Digital Festival Microsoft mobile web PHP rankings SEO smartphones social media Twitition Twitter URL user experience web design web usability Windows Windows 8 WordPress YouTube Zend Framework

© 2013 Branded3 Search Limited Company reg. no. 06479012, All rights reserved.
Part of

St Ives Group Logo