Comments on: Faster Google Crawl Rate

By: Collin LaHay

Collin LaHay — Sun, 11 Jan 2009 01:17:48 +0000

The spiders visiting more month will never hurt you, but it will use a lot more bandwidth which may be a problem for some people.

By: iGuide

iGuide — Sat, 10 Jan 2009 23:52:06 +0000

And what if your site DOESN’T update that frequently, say only once a month? Then, would it actually hurt you to set your settings to “faster” and let the bot discover your pages don’t change that often? I already see Google and Yahoo are each now pulling 3-4 gigsabytes a month, plus another 2 or 3 gigabytes for MSN. That sounds like a lot, but all spiders put together still account for lass than half of traffic.

By: Collin LaHay

Collin LaHay — Thu, 07 Feb 2008 13:40:39 +0000

Blogs that Google thinks should be crawled more often. The only way to find out is to check Webmaster Tools.

By: Bolkie

Bolkie — Thu, 07 Feb 2008 12:48:06 +0000

Does this option work for established blogs only, or also for newer/fresh blogs?

By: paulette

paulette — Thu, 31 Jan 2008 17:19:28 +0000

Thanks for the info. Google really is a fast tool for searching

By: Karel Geenen

Karel Geenen — Wed, 30 Jan 2008 22:54:30 +0000

My Dutch blog doesn’t have the faster crawl option. However my posts get indexed within 10 minutes, always.

My advice is to check first how long it takes before a post get’s indexed. If it takes to long, activate the faster crawl. If it gets indexed within the hour, leave it as it is.

By: SEOMeter graphs your Google crawl rate | Make Money Blogging

SEOMeter graphs your Google crawl rate | Make Money Blogging — Sun, 27 Jan 2008 20:17:35 +0000

[...] it myself. I wish I would have joined a month ago to see an accurate growth after switching to the faster google crawl option in my webmaster [...]