I’m often asked how Google gathers the page information it features in its search returns. Well, who better to explain this than Matt Cutts, head of Google’s Webspam team.
Matt explains the fundamentals of how Google’s crawl system works, its indexing of the pages it crawls and how it returns information in response to search queries.