Informing Google - Google Sitemaps

https://www.google.com/webmasters/sitemaps/login

Google Sitemaps is an experiment in web crawling. Using Sitemaps to inform and direct our crawlers, we hope to expand our coverage of the web and improve the time to inclusion in our index. By placing a Sitemap-formatted file on your webserver, you enable our crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly.

Google Sitemaps is a great development in this direction. better than robots.txt

// chall3ng3r //