Too many on page links in sitemap.html
-
My crawl report is flagging an issue with too many links to one of my pages, this page is my sitemap.html. However, I have coded the page so that if required is specified it generates an .xml version of the page and if not then the html version is displayed. What is the best way to stop the crawl finding the html version whilst maintaining it on the site for clients navigation?
-
The thing to remember is that the HTML version should only ever be used for users and not to redirect robots if they hit a 404 on your .xml file. The reason for this is that search engines may still see the file as 404 after the redirect or a 301 redirect, if the later you then have an issue of search engines thinking it was there but is now the html page. Which of course is not a good thing.
I would advise ensuring the fall back never happens to robots / spiders - if the file is just a 404 SE's will return to it, they may not if it is 301 redirect.
-
Thanks for the response,
This was the first thought, but I wasn't 100% sure that hiding it in the robot.txt file should solely remove this issue and it is still early.
Thanks again.
-
hide it using a robots.txt file - though you could also use the noindex meta tag ... this being said search engines in general recognize sitemap pages and aren't too fussed by them, its a good jumping off point for them to find info.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
When using external links for onsite optimization, should they be follow or nofollow links?
I'm trying to optimize my home page and need to add external links. I'm planning to link to other authoritative sites. Should they be follow or no follow links?
On-Page Optimization | | ntaparia171 -
Duplicate Page Content - default.html
I am showing a duplicate content error in moz. I have site.com and site.com/default.html How can I fix that? Should I use a canonical tag? If so, how would i do that?
On-Page Optimization | | bhsiao0 -
Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag, A description for this result is not avaliable because of this site's robot.s.txt The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though. Anyone else had this happen and have a fix?
On-Page Optimization | | mac22330 -
Too Many On-Page Links, Can You HELP???
This is the best architecture I found to help my visitors find there furnace filter size. Does it hurt my SEO? Index page has, 210 links and most other pages has, 190 links. Thank you, BigBlaze
On-Page Optimization | | BigBlaze2050 -
Should we add a link from every page with main keyword back to homepage
Dear all, We have a call for action on the bottom of all our 10K plus pages which has the words private jet charter in it. Here is what the sentence looks like: Call +1-877-727-2538 to hire private jet charter flights or get a private jet quote The "private jet charter" link goes to the homepage - the homepage has always ranked for the same keyword. Even though we have a separate page for private jet charter itself which may or may not be competing with homepage for the same keyword. The question is - does this help our efforts to rank higher for private jet charter or does it not. It used to be that the more links from all pages for specific keyword coming back to homepage was good - but now maybe algorithms may have changed and not sure.
On-Page Optimization | | Richard7770 -
If a site has https versions of every page, will the search engines view them as duplicate pages?
A client's site has HTTPS versions of every page for their site and it is possible to view both http and https versions of the page. Do the search engines view this as duplicate content?
On-Page Optimization | | harryholmes0070 -
Lots of links on homepage to internal pages with keyword rich anchor text - problem?
Hi, All! We have a new potential client, that when looking at his site with a tool, we noticed that the previous SEO company they worked with filled the homepage copy with lots of keyword-rich anchor text links pointing to different pages on the site - many links going to the same page, just with different keywords. These links are not indistinguishable in format from the other text, which is why we only noticed it with a tool. I certainly wouldn't recommend doing that to start with, but once all these links are there, would you recommend taking them down? Is there any conceivable chance it could help the site? Is there a significant reason to think it will harm the site? Or will it just be pretty neutral? In all that's been written (much by SEOMoz) about only the first link's anchor text counting, do subsequent links work like a no-follow in the sense that they are a waste of the link-juice of the page, or is it as if they aren't there at all? (And is "only the first link counts" still the most widely held theory, or have there been new developments since?) Thanks, All!
On-Page Optimization | | debi_zyx0