Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What tool can I use to find the top traffic-driving keyword for a batch of pages from multiple sites?
I thought I might be able to use Ahref's Batch Analysis for this, but that just gives stats on backlinks. I have a several lists of thousands of pages scraped for particular sets of keywords, but what I need is some way to automate fetching the biggest keyword that each page ranks for - biggest being the keyword that is estimated to drive the most organic traffic. Is there a tool out there that does something like this?
Competitive Research | | helenlorettahasan0 -
Selling on eBay and Amazon, does it have a negative impact our your website?
_We sell on multiple platforms I.e own website, eBay, Amazon and have noticed over the last few years to hold a page 1 ranking on Google is becoming more and more difficult as the SERPs are saturated with the big brands. _ My question is, we've loaded all of our products and there lovely unique descriptions to eBay and Amazon, is there any chance that this content is helping eBay and Amazon rank (may be not by much!), but certainly not doing us any favours. As effectively why would you show our site in the search results for a product range, when all of the content/products already appear on eBay/Amazon which is several SERPs places higher? Is Google not inclined to think, "hey no need to show x site, as the content is already features on Amazon, why show it twice?" Any one have any thoughts?
Competitive Research | | bnknowles10 -
Relevancy vs Quality of the website in blog commenting
For example, I would like to comment on a do follow blog with my link inserted in the comment. The blog post is relevant with the link i inserted however there are too many spammy links on the comment. Will this affect my website in terms of "link neighborhood" even my site is relevant to the blog? how do you judge whether the blog is worth commenting and putting your link on it? Does link building on blog comments actually hurt the page rank of websites if it go wrong such as spammy sites?
Competitive Research | | andzon0 -
How can I track relevant websites my visitors are viewing?
I'm wanting to build a in-depth profile for my company's typical site visitor and I was wondering if there is anyway to view other websites that visitors are searching for online to get an idea of their hobbies/interests and how they spend their free time. I'm not sure if I'm asking the right questions in Google because the results are very broad and are more about reading analytics for your own company. Can anyone point me to a website or software that allows for this sort of thing?
Competitive Research | | CleanEdisonInc0 -
Why is my website not in the top 3 if our Moz statistics are better?
Hi, We've been using Moz, for our E-commerce sites, for some time now and are improving all of our statistics, be it on-page for specific keywords or general crawl errors, but I've not been seeing a lot of change in our rankings... (we've moved from place 7 to 6 on our main keyword). I'm thinking of looking at our backlinks, through Link Detox, after we finish our Moz optimisation to see if anything weird is going on with that. Are there any other areas I should be looking at? any other clues as to why we're not ranking higher than our competitors. Even if our Moz statistics are better and our Market Samurai values are similar? Thank you very much! Alexander
Competitive Research | | WebmasterAlex1 -
Creating Free Website Accounts (Weebly, Wix, Wordpress.com, etc) for Linking Purposes?
Greetings Mozzers, I came a cross several sites and when looking at their link profile I found they had several links from these free services to gain links. Obviously duplicate content is bad, but if all the content on each one was completely unique, would these links be of quality? Let's say, 1 link per site that is external to your site. I know it's a tricky topic but just wanted thoughts, would the above be a potentially beneficial method for gaining a simple quality link. Your advice and information is much appreciated!
Competitive Research | | MonsterWeb280 -
Where do we find a Keyword Discovery Tool in SEOmoz?
I've been looking for a way to compare keywords amongst my competition websites.
Competitive Research | | homesonthesound0 -
How do I find the best converting keywords
I rank decently on local search for some of my keywords but find that the traffic coming to my site is not from those keywords. I also find that they never convert to sales queries. Is someone able to help me out with that? Thanks My domain is www.hykano.com
Competitive Research | | Skwtayler0