Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Selling on eBay and Amazon, does it have a negative impact our your website?
_We sell on multiple platforms I.e own website, eBay, Amazon and have noticed over the last few years to hold a page 1 ranking on Google is becoming more and more difficult as the SERPs are saturated with the big brands. _ My question is, we've loaded all of our products and there lovely unique descriptions to eBay and Amazon, is there any chance that this content is helping eBay and Amazon rank (may be not by much!), but certainly not doing us any favours. As effectively why would you show our site in the search results for a product range, when all of the content/products already appear on eBay/Amazon which is several SERPs places higher? Is Google not inclined to think, "hey no need to show x site, as the content is already features on Amazon, why show it twice?" Any one have any thoughts?
Competitive Research | | bnknowles10 -
White branded website & SEO
Hi guys, We might have as a new project to create a white branded website for a big portal in our local market (which have a strongest domain than ours): the goal will be to reach their big mass of users and if possible, place this new site BEHIND us on the SERPs. Since the content of the new website will basically be the same, we are considering 2 solutions: to "noindex" the site on search engines, which is a "secure" way to not create ourself a competitor to allow the site to be indexed on search engines but using the "rel=canonical" strategy to not be affected by duplicate content penalties (For example, we plan to add rel='canonical' href='http://www.ourdomain.com/category1/product2' /> on their page http://newsubdomain.theirdomain.com/category1/product2) The main question is: can the white branded website rank better than our site even with the "canonical" strategy? (Of course we could "lower" the quality of the white-branded website pages to avoid that risk... but if somebody has better advices, we would be glad to hear them 😉 )
Competitive Research | | Kuantokusta0 -
Ecommerce Website Product Rich Snippet Image
Greetings Mozzers, I'm working on an ecommerce site and my goal is to have the product rich snippets on each of them however, I would like an image to start displaying in the SERPs. Looking for some guidance on this issue. Here is a well phrased questioned I found that sums up my thoughts: Product schema has the "image" attribute, but it is not displayed in rich snippets in SERP. However, there is recipe schema and it allows to show image directly on SERP. It means that we can define two entities on a page (product and recipe, it is allowed) and it should display an image from recipe's part + the rest of information (price, availability) from product's part. I know it is a dirty hack and semantically incorrect, but will it work? If so, would it affect rankings or not? Any other drawbacks? Thank you for any advice/clarification!
Competitive Research | | MonsterWeb280 -
Creating Free Website Accounts (Weebly, Wix, Wordpress.com, etc) for Linking Purposes?
Greetings Mozzers, I came a cross several sites and when looking at their link profile I found they had several links from these free services to gain links. Obviously duplicate content is bad, but if all the content on each one was completely unique, would these links be of quality? Let's say, 1 link per site that is external to your site. I know it's a tricky topic but just wanted thoughts, would the above be a potentially beneficial method for gaining a simple quality link. Your advice and information is much appreciated!
Competitive Research | | MonsterWeb280 -
Finding new links to site
Is there a way to find sites that linked to my site during a certain time period? Say in the past 2 weeks or from March 1-March 15th ?
Competitive Research | | priceseo0 -
Traffic estimates for any website?
Google's Display Network Ad Planner used to be the best for this (although was often still way out), but the data for the sites I used to check has disappeared. Does anyone know any other sites that provide half-decent estimates of traffic? trafficestimate.com, Compete and Alexa are way off. I'd be interested in paid services too. Thanks. 🙂
Competitive Research | | Alex-Harford0 -
Why does the link analysis of my website say I have no links?
When I click on the "Link Analysis" tab it says my website has a domain authority of 1 and has 0's for every other category. When I run it in Open Site Explorer - it says I have a page authority of 51 with over 4600 links. My website also seems to be at a stand still over the past several weeks. Anyone know why the two Link Analysis is not showing anything? Thank you
Competitive Research | | tyler7560 -
How do I know top pages (first on Google) for one website?
Hi! I'm SEOMOZ PRO user and I want to know which pages of other website are ranking on top on Google, Yahoo, Bing, ecc... with relative position (rank). Is there a features of SEOMOZ for it? Regards
Competitive Research | | jadlib0