atom

Google Using RSS/Atom For URL Discovery

Google's newest method for crawling your websites, is to use your RSS/Atom feeds to discover new page URLs.

Google found the RSS/Atom feeds far surpass Google's traditional crawling method in speed and accuracy. Google traditionally follows links from one source to another in a spiderweb fashion discovering and indexing new URLs as it crawls through the pages.

Syndicate content