Googlebot
September 30, 2013 | | Kris Tabetando | 0 Comment
Googlebot is the software that Google uses to crawl web pages on the Internet. It indexes these pages to build a directory of web pages that can searched by users of the Google search engine. The Google algorithm then ranks these web pages for specific keyword searches in the search engine.
Googlebot finds new pages primarily by following hyperlinks on each page it has already discovered. All of this occurs automatically. However, webmasters can also manually submit web pages in XML sitemaps to Google for new web pages to be indexed.