Skip to content
Search engines 5511dd3

Sitemaps and Spidering

Rand Fishkin

The author's views are entirely their own (excluding the unlikely event of hypnosis) and may not always reflect the views of Moz.

Table of Contents

Rand Fishkin

Sitemaps and Spidering

The author's views are entirely their own (excluding the unlikely event of hypnosis) and may not always reflect the views of Moz.

Sitemaps and Spidering

The great advantage of a sitemap (for SEO purposes) comes from its ability to reduce the number of links that must be followed in order to reach all pages on a site. Sitemaps have a unique ability to garner the attention of search engine spiders and crawlers - making for much faster indexing, and thus, faster rankings.

The boost provided by sitemaps hasn't been measured in full, but many SEOs suspect that bots may have an innate ability and preference for spidering sitemaps. Several rules govern the construction and maintenance of sitemaps to achieve optimal benefits:

  1. Make sure your sitemap is linked to by every page on the site (this ensures even distribution and increases the frequency of spidering.
  2. Don't have more than 200 links on a sitemap page. In Google's ancient recommendations page, this number is 100, but reports from around the SEO community indicate there is no detriment to having up to 200 links on the page.
  3. Try to refrain from external linking on the sitemap page. For both users and spiders, the sitemap has an established purpose as the index of your website's own pages. Externally linking is a detractor.
Back to Top

With Moz Pro, you have the tools you need to get SEO right — all in one place.

Read Next

The Mozbot Mashup: Roger Explores the World of Generative AI Imagery

The Mozbot Mashup: Roger Explores the World of Generative AI Imagery

Mar 07, 2023
One Secret to Improve SEO in 2021: Guestographics

One Secret to Improve SEO in 2021: Guestographics

Jul 21, 2021
Pop-Ups, Overlays, Modals, Interstitials, and How They Interact with SEO

Pop-Ups, Overlays, Modals, Interstitials, and How They Interact with SEO

Apr 28, 2017

Comments

Please keep your comments TAGFEE by following the community etiquette

Comments are closed. Got a burning question? Head to our Q&A section to start a new conversation.