Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I can see competitors ranking for certain long-tail keywords but cannot find them on web pages. What am I missing?
Hi there. I'm pretty new to SEO and I've been doing a fair bit of training but there is one aspect I have yet to grasp. When I carry out keyword research, I get all these results and I understand the metrics. What I'm not getting is, when a competitor is ranking highly for say "where can I buy fresh turkeys", I assume that that phrase must appear somewhere on the page, but it doesn't. I realise I'm just not thinking about this in the right way. Can anyone offer clarification, please? Kind regards, Bruce
Competitive Research | | BruceBarbour0 -
I am looking to find the top pages based on traffic volume on my competitors websites, does anyone know of any good resources?
I want to know how which pages on my competitors websites are the most popular based on the traffic volume. I do not care how many links or directed to that page or any other metric. Only thing I am looking for is the traffic volume. It would also be nice to know the length of time spent on that page.
Competitive Research | | kanteenboy0 -
Why is our website ranked lower but beats most competitors in full SERP report?
We are analysing why our website ranks so low (currently position 8 in serp). We beat our competitors in most areas. Also we produce by far the most useful content. Do not buy links or do any other malpractice. We have been for a long time ranked in top 3 (well mostly 1-2) positions. In the last year we have seen a decline to position 8-10 and we are not sure why this is the case. Can anyone suggest what we should be focusing on? We are clueless. All the practices we used to "know" now seem obsolete. m8qIeyC,Kf1LLei#0
Competitive Research | | urkeman0 -
What is a recommended sitemap generator to use for both us and our clients?
Right now we are using xml-sitemaps.com however it looks like it isn't generating an accurate or lengthy sitemap. Do you have any recommendations?
Competitive Research | | MonsterWeb280 -
Free tools to find country of origin of backlinks/urls
Hey are there any free tools out there which can allow me to insert a large list of urls, and it determines the country of origin of the domain. I know the paid version of majestic does, but i was wondering if theres any free tools? Cheers, Chris
Competitive Research | | monster990 -
Where do we find a Keyword Discovery Tool in SEOmoz?
I've been looking for a way to compare keywords amongst my competition websites.
Competitive Research | | homesonthesound0 -
How to find a neutral rank for a webpage a keyword term?
Hi!
Competitive Research | | lilactree
I'm sure this has been answered here already - I'm just not searching for the right words. I'm trying to find the ranking for a website for specific terms. Being that the search engine remembers what I search (I try to log out, privately browse, etc), everything matters and impacts my search. I'm trying to see what a website ranks for a person who has never visited that website before, or doesn't have other factors influencing the result. I tried the keyword research tool, and while that seems to deliver what I'm after, it only gives 1-10. Even though these are the coveted positions 😉 I'd like to know if a website isn't ranking there, and is further down. We track the progress made after work is done to a page, to see if it moves up, and what other tweaks we need to make to improve the rankings and attract clicks. Thanks!0 -
Help with website
Hello, I've been trying to get our website on 1st place (or at least 1st page to start) on several keywords, on google in all English speaking countries. In most of them I managed, but in USA I'm on 5th page. By Domain Analysis we are better than competition. Keywords are glass nail files, crystals nail files (some long tail keywords are ok, we are somewhere on top). Website: http://www.czech-glass-nail-files.com/ We worked on code, design (notice issues is just recent, because of server migration), on-page, blog. Can someone help me out with an advise? The goal is to be #1. We definitely doing something wrong, but I can't figure out what. Thank you.
Competitive Research | | divan0