Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I am looking to find the top pages based on traffic volume on my competitors websites, does anyone know of any good resources?
I want to know how which pages on my competitors websites are the most popular based on the traffic volume. I do not care how many links or directed to that page or any other metric. Only thing I am looking for is the traffic volume. It would also be nice to know the length of time spent on that page.
Competitive Research | | kanteenboy0 -
Methods for estimating competitor website traffic from natural search
Hi all, I'm currently working on some competitor analysis and estimating website traffic based on rankings and estimated search volume for approximately 500 keywords. I'm then estimating based on click through rate from Webmaster tools. I think this will give me a relatively accurate estimation but was wondering how everyone else does this? Any other methods out there? Thanks, Elias
Competitive Research | | A_Q0 -
How can I track relevant websites my visitors are viewing?
I'm wanting to build a in-depth profile for my company's typical site visitor and I was wondering if there is anyway to view other websites that visitors are searching for online to get an idea of their hobbies/interests and how they spend their free time. I'm not sure if I'm asking the right questions in Google because the results are very broad and are more about reading analytics for your own company. Can anyone point me to a website or software that allows for this sort of thing?
Competitive Research | | CleanEdisonInc0 -
Finding Local SERPs
Good Afternoon Everyone, I am looking into finding a tool that can use different IP addresses for local markets to find what their SERPs look like for searches such as: Cogs in Calgary Cog Installer Miami Cog Repair New York With local IP addresses for that search in that market. Not sure if such a thing exists, but thanks in advance!
Competitive Research | | RandyEpp0 -
Where do we find a Keyword Discovery Tool in SEOmoz?
I've been looking for a way to compare keywords amongst my competition websites.
Competitive Research | | homesonthesound0 -
Analyzing Back Links - Says site A has back link to Site B but when I look at site B I can't find any back link to Site A. Why?
I am new to SEO Moz - It looks like incredible technology. I was playing around with different websites to see where they had back linked to see how it works. Looked at a site called racingsecretsexposed [dot] come and it said that it had dozens of links to www.ndesignstudio.com such as: ndesign-studio.com/blog/best-wordpress-sites?replytocom=893 with link anchor text "laying horses" but when I do a search for the company name, or the anchor text "laying horses", or the owner of the company's name on ndesignstudio.com - nothing appears. Why not? Isn't the back link anchored by the text laying horses, which should link back to the racing secrets website? Thanks
Competitive Research | | NewtoSEO900 -
How do I find the best converting keywords
I rank decently on local search for some of my keywords but find that the traffic coming to my site is not from those keywords. I also find that they never convert to sales queries. Is someone able to help me out with that? Thanks My domain is www.hykano.com
Competitive Research | | Skwtayler0 -
Can i have chance to rank higher than official website in google local domains ?
Q : can i have chance to rank higher than official website in google local domains ? for example : rank higher than microsoft,kaspersky,nokia etc... in google italy or google germany or any other local domain for google
Competitive Research | | activeacts0