Article written

Getting Indexed Faster (Set Googlebot to Faster) 7

Dec11

I was browsing through Google’s Webmaster Tools, and after submitting and verifying TYPELiFE, I noticed when I expanded the “tools” tab on the left, there was a menu option that said “set crawl rate” … hmmm, I wonder what this does?

A quick skim over the tool page shows me:

“Google collects documents on the web using Googlebot, our web crawler. You should leave this control at the Normal setting unless you are having trouble with the speed at which Googlebot is crawling your server.”

“We’ve detected that Googlebot is limiting the rate at which it crawls pages on your site to ensure it doesn’t use too much of your server’s resources. If your server can handle additional Googlebot traffic, we recommend that you choose Faster below.”

It also lets you know the current rate Googlebot is indexing your website.

If you think you can handle it, choose a new crawl speed! I set mine to faster, now I’m just waiting to see the results!

This site is currently set at a Faster crawl rate. This rate will return to Normal on Mar 10, 2008.

This website uses IntenseDebate comments, but they are not currently loaded because either your browser doesn't support JavaScript, or they didn't load fast enough.

subscribe to comments RSS

There are 7 comments for this post

  1. This is quite a hot information. I’ll share it on Delicious.

  2. Agitationist says:

    Great find! I’m going to try this. Thanks!

  3. gadgets says:

    Yes you are right it is used for setting the crawl rate and i too tried to set the crawl rate for my website but nothing was the outcome but when i done the same thing with my blog the results were shocking, google crawl my website as per my crawl but the condition was that my content should be updated every five times per day and that’s true . i do it

  4. Anna says:

    I need some feedback from people who can tell me why google bot has not indexed my blog. There have been problems from day one and I’ve exhausted every possible fix. ANYONE HAVE ANY ADVICE? Thanks.

    The URL is http://www.handwarmer.org

  5. The Hip Zone says:

    I think this option should be used only when you have some serious problems or you are going to have content very fast. I think Google bots are very clever and they can determine that you have done something unnecessary.

  6. suresh says:

    hahaha,

    even i have tried this thing but, nothing seem to be working, infact after some days the fater option was greyed out for me. hehehehe, i think google doesnt want to index me that fast.

    did googlebot indexed you any faster?.

  7. Anonymous says:

    I have a site called Transfer Technology University and the faster mode didn’t help me very much… maybe this rank is a time investment in which you have to work real hard and get your site better and better.

Please, feel free to post your own comment

* these are required fields

Internet Marketing Strategy is powered by WordPress and FREEmium Theme.
developed by Dariusz Siedlecki and brought to you by FreebiesDock.com