Is a site map necessary or recommended?
-
We have a website that has been up for the past 4 years without a site map.
Google is indexing it. Do we need a site map? Do you recommend we create one and submit it to goggle and bing?
The site is www.logobids.com
Thank you.
-
Hi Mike,
Thanks for the tip. I checked and our .xml sitemap has 55 pages and Google is indexing 53. not sure what the 2 missing pages are or how to find out, but I imagine the difference may have to do with blog archives or something along those lines. At any rate, I'm reassured by this. Thanks again.
Gina
-
Hi Gina,
If you use Google Webmaster Tools you can see how many pages you submitted on your sitemap and how many Google has indexed under Optimization > Sitemaps.
It will also list if you have an issues with your xml sitemap.
Hope this helps.
Mike
-
I would say that the sitemap is not needed per say, however, it is good practice to have one, whether it be for client navigation around a site or to assist Google with the root navigation of the website.
From the earlier days in my SEO career I was taught to always incorporate a few standard items as basic procedure as they once you are used to the routine you cannot do any harm if even Google no longer needs then, these were things like sitemap.html, sitemap.xml and robot.txt.
It seems like Google is no longer taking a sitemap for the same purpose as it used to as the technology is advancing, so it now seems like personal preference.
A little bit like the old:
"Which should you do first, On-page SEO or Off-page SEO?" debate.
Hope this helps.
-
It's not needed per se, but then if you have a large website and you think about the user and you want them to be easily able to find sections of your website, it can't hurt to have a HTML sitemap.
As for XML sitemap, the only reason I consider doing them to make sure if there are any issues of indexability, I know. So that I can act on that information and do something. Otherwise for a large scale website with over hundreds and thousands of pages, how'd you know if you have a section of your site not indexed for whatever reasons ?
-
This is a strong indicator something is up and deserves deeper investigation.
Perhaps you have content duplication issues, low value content (Panda), spammy back links (Penguin) or other indexing issue. See if there is a pattern to the missing pages, perhaps one of the directories is the cause. How old is the site and how is the domain trust/authority coming along?
-
I'm jumping in here with an offshoot question for Mike. (or anyone else with an idea)
You suggest "If you Google site:logobids.com you can see which of your pages Google has indexed."
I just tried that and only 10 out of 40+ pages on our site are coming up. We have both an html site map and an xml site map on our site. There isn't any noindex code on the site other than for blog comments.
Any idea why Google isn't showing them all?
Thanks!!
-
A stale or poorly created sitemap can hurt in the following ways:
- long lived 404 pages - deleted pages continue to be indexed if not removed from the sitemap
- use up Google indexing allowance - if 404 and low value pages are included, Googlebot will use up valuable indexing allowance on them vs covering more of your important content.
- links to private areas - depending on how the map is created, the tool may not be smart enough to not include administration or community pages that you don't want in the index.
- inclusion of noindex pages - a couple methods (such as a robot.txt update after a sitemap is created) will include noindex pages which a technical problem. I'm not 100% sure of the impact but I could see this being a quality indicator.
- create distracting work - maintaining sitemaps, particularly semi-manual ones from Xenu etc., suck time better spent improving your indexability or earning back links.
However, all of these are easily avoidable with a solid approach and/or good server side tools.
-
Thank you for the responses. It seems like it is something that cant hurt the site or the indexing. The sacrifice is my time, other than that it has nothing but upsides and no downside.
I think we will go forward with creating the site map and submitting to Google.
-
I don't have a site map on any of my sites. Never any problem getting indexed or ranking. None.
-
I may get chastised for this but I believe the value of sitemaps is over stated.
All things being equal, I feel they are crutches and band-aids for poor webdesign/production.
Your site should:
- be easily indexed by all engines
- expose all pages with in four-five links of the home page(s)
- utilize thoughtful linking to promote important content in an organic manner
- expose new content on a high value, frequently indexed page (ie the home page) long enough to be found
- be consistent enough that the site will seem similar after one or two passes by Googlebot.
I like sitemaps when big structural changes occur as the sites heal faster. They're good when a lots of pages are only exposed via a long pagination scheme. I also use them to break down parts of a site to expose problem areas (IE when a sitemap has 50 links but Google only indexes 25 of them)
But, they can be detrimental if they are not maintained properly. If anything changes in the structure, it should be immediately reflected in the sitemap. Lots of automated ones don't consider the robot.txt file which can cause problems.
For SEOs, adding a sitemap is an easy way to ensure everything is at least looked at without having to touch the actual site.
Advice: yes, use them but only if you can use them properly or can't fix current indexing issues. Over the long haul however, you should force yourself to think of it as not there.
-
A sitemap is like a map with driving directions for Google. Sure they can probably find their way through your site, but with a map they can get through more efficiently and make sure to look at all of your pages.
It is not required for a site to get indexed.
If you entire site is indexed, you don't "need" a sitemap; however, it is good practice to have one.
Say you add a new page and want it to get indexed quickly by Google, you would just update your sitemap and submit it to Google. It alerts them you have made changes and to reindex your site.
If you Google site:logobids.com you can see which of your pages Google has indexed.
Hope this helps.
Mike
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site name in page title - leave it or remove it?
Hi all, Recently came across some authority blog (quicksprout to be precise) which stated that apart from main page, contact page, about us and some other generic pages, site name should be removed as it might produce duplicate content. example "How to blog | Example Site name" This mostly is the issue with tags and categories pages as it shows on Moz issues. Is that really a problem and site name should be taken off them? Thank you.
On-Page Optimization | | Optimal_Strategies1 -
Reducing number of site pages?
Hi, I am looking through my site structure and I have a lot of pages left over from the days of article keywords. Probably 7 or 8 years ago, someone sold my husband on article key word pages. I have slowly gotten rid of a lot of them as they have fallen out out of the ranks. I would like to get rid of the rest, probably 5 or 6 pages. Will it hurt my rankings to delete pages and redirect them? My customers really like the simplicity of our site and I want to keep it that way, plus clean up flags that Moz is telling me is a problem. I think its easier to keep less pages top notch than have to worry with a lot of them. Especially since my customers aren't viewing them. Thanks in advance!
On-Page Optimization | | CalicoKitty20000 -
Stumped: Site No Longer Showing Up for Important Keywords
URL is: www.radianceofpalmbeach.comGreetings All:I have been working on our company's website for months, and I am finally at wit's end. The site was very out-of-date and had unfortunately been built upon some bad links before my arrival. My partner and I have redone the site with SEO best practices in mind: we created new content for the pages, and have been working diligently on correctly organizing the site. Despite everything we have done, our site has plummeted since September in terms of organic search. Here are some of my suspects: Panda/Penguin: a lot of the content of the old site had been copied. We did our best to make our content helpful and original, but I'm not sure we did enough. Also, many backlinks were suspect. I disavowed all that I didn't like Dec. 8. I have seen minor improvement, but not much. Name Change: Around late October, coinciding with one of the algorithm changes, the doctor insisted we change our name from New Radiance Med Spa to New Radiance Cosmetic Center. We noticed overnight tumbling, but it literally happened at the same time many were complaining about Penguin. Pages too far removed from root directory?: We tried to silo the site by category to make it specific, but I'm not sure if we went too far from the root directory. For example, our botox page is: http://www.radianceofpalmbeach.com/services/injectables/neuromodulators/botox-cosmetic/ -- Should it just be ./botox ? Everything is only one link away, so we didn't foresee a problem. No alternate forms of navigation: Our navigation is solely drop-down. Content Issues: Since the site launch, my boss has changed the organization of the site around. I don't think this should be a problem, but I honestly don't know. Technical Issues: We use a Wordpress site, and the designer has been pretty good about making the site clean and without errors, but perhaps there is something I am overlooking? ??: Despite these issues, I feel like our site should be considered better than many of our competitors who nonetheless perform much better than we do on important keyword searches. Type in "liposuction palm beach" or "botox palm beach" and we don't even come on page 1, whereas we used to dominate. Any suggestions would be greatly appreciated, as, like I said, we are stumped. I feel like I have looked up every possible problem, and with the above list, we feel frozen as to which direction to turn.Thanks in advance,Michael
On-Page Optimization | | mikedelseo0 -
Pre-launch site or not
We are going to set up a new site in four months. Historically we always set up a simple Wordpress "Pre-launch-site" with relevant texts to start ranking in the SERP. Anyone with experience of doing/not doing this and what is had led to? A site with relevant texts also should have incoming links, which needs more work.
On-Page Optimization | | fredrikahlen0 -
How much content does Google Crawl on your site?
Hi, We've had a debate around the office where some people believe that Google only crawls the first 150-200 words on a page and some people believe that they priority content that is above the fold and other people believe that all content has the same priority. Can you help us? Thanks,
On-Page Optimization | | mdorville
Matt0 -
Site Maps / Robots.txt etc
Hi everyone I have setup a site map using a Wordpress pluggin: http://lockcity.co.uk/site-map/ Can you please tell me if this is sufficient for the search engines? I am trying to understand the difference between this and having a robots.txt - or do I need both? Many thanks, Abi
On-Page Optimization | | LockCity0 -
URL Structure for Home Decorating site
Hi, I am about to launch a home decorating ideas website. I am stuck to determining the ideal URL structure, and the options are: Category: myhomedecoratingsite.com/room/master-suite/
On-Page Optimization | | adepalma
myhomedecoratingsite.com/kitchen/
myhomedecoratingsite.com/room/living
myhomedecoratingsite.com/master-suite/
myhomedecoratingsite.com/living-room/ Post: myhomedecoratingsite.com/interior/beautiful-master-suite/
myhomedecoratingsite.com/interior/cozy-living-room/
myhomedecoratingsite.com/room/master-suite/beautiful-modern-suite/
myhomedecoratingsite.com/room/living/cozy-contemporary-living Are these any good? What your best suggestion? Thanks in advance for your inputs. Al0 -
I changed my site from HTML to PHP and I need to get some help.
Ok...so the other day I went from HTML to PHP in every part of my website. I want to know the best option for me for redirecting my pages from HTML to php. I had my site scanned with SEOMoz and I was given many 404 errors which is not at all good. I do not have any pages of my site linking to any of these html pages. All of the site links have been updated. I have checked 3 times. I have never created a robots.txt file so I would love to get a little help with this part. I was thinking it would be best to tell Google not to worry about these pages in the file. I kept the pages up and I plan to remove all code with them so that no content shows up if someone visits but the issue with that is my site is already indexed as HTML. I want to have the HTML pages redirect to the PHP without worrying that my visitors will land on my site via Google onto an HTML page. I hope I am making sense. What is the best advice you can give me. I need all pages to redirect to PHP. I used an htaccess redirect from all HTML to PHP but when I get so many of them added I get an error on my site saying too many redirects. Seriously need help.
On-Page Optimization | | TrendyHost0