The Crawl Rate tracker gives reporting on how often your site is crawled.
| Author: | Patrick Altoft (profile at wordpress.org) |
| WordPress version required: | 3.1 |
| WordPress version tested: | 3.1.4 |
| Plugin version: | 2.0.2 |
| Added to WordPress repository: | 03-08-2011 |
| Last updated: | 08-08-2011
Warning! This plugin has not been updated in over 2 years. It may no longer be maintained or supported and may have compatibility issues when used with more recent versions of WordPress.
|
| Rating, %: | 20 |
| Rated by: | 1 |
| Plugin URI: | http://www.blogstorm.co.uk/wordpress-crawl-ra... |
| Total downloads: | 5 093 |
| Active installs: | 100+ |
 Click to start download |
|
With the advent of Google Analytics and other JavaScript based solutions a lot of webmasters have lost the ability to easily analyse log files to see how search engines are interacting with their site.
Google Webmaster Central offers a nice graphing feature so you can see the crawl trends but there is no way to access meaningful data. Studying crawl rate is hugely important because it helps you find out which pages are trusted most by the search engines (especially Google). The more Google trusts a page the greater the frequency it will re-visit that page. If you build a few deep links and see your crawl rate for the target page suddenly increase you can be confident that the links are highly trusted and that you should try to get some more.