Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO newbie here - I cannot seem to find the direct answers to a few queries that I have
Hi, Apologies if these are very simple queries, but I cannot seem to find the answers anywhere. I understand meta keywords are pretty much pointless nowadays, however when I run a report on another 'keyword website' - my website only ranks for around 2k keywords where my competitors rank for much more (around 20k). I was just wondering where these keywords are found, as I can only assume that these are meta keywords? The company that I'm working on the SEO for is a holiday agency that specialises in holidays abroad for disabled people, so that means that we have a niche product/service and whilst we rank fairly high for some keywords, we would like to rank higher. How is it possible to work towards ranking higher for particular keywords? When doing keyword research 'disabled holidays' has a lot more search traffic than 'accessible holidays'. We are called Enable Holidays and our main competitors have the words 'disabled' and 'accessible' in their domain's, so I would imagine that it's going to be hard to potentially rank higher than our competitors for these keywords? Could someone put me in the right direction of how you improve rankings in the SERP for certain keyword searches? For example, do we have to write more content on a certain page about a keyword? Do we have to include more long-tail keywords in the content? Any help is appreciated. Thanks
Competitive Research | | enableholidays0 -
How can I find out the exact match visitors for a competitor's website?
Hi, I'm trying to find a way of finding out the estimated number of exact match visitors that a competitor's website has got. I know that SEO agencies can find this out, and there must be a way of doing this for myself. Thanks
Competitive Research | | MThacker0 -
Relevancy vs Quality of the website in blog commenting
For example, I would like to comment on a do follow blog with my link inserted in the comment. The blog post is relevant with the link i inserted however there are too many spammy links on the comment. Will this affect my website in terms of "link neighborhood" even my site is relevant to the blog? how do you judge whether the blog is worth commenting and putting your link on it? Does link building on blog comments actually hurt the page rank of websites if it go wrong such as spammy sites?
Competitive Research | | andzon0 -
How can I track relevant websites my visitors are viewing?
I'm wanting to build a in-depth profile for my company's typical site visitor and I was wondering if there is anyway to view other websites that visitors are searching for online to get an idea of their hobbies/interests and how they spend their free time. I'm not sure if I'm asking the right questions in Google because the results are very broad and are more about reading analytics for your own company. Can anyone point me to a website or software that allows for this sort of thing?
Competitive Research | | CleanEdisonInc0 -
Finding new links to site
Is there a way to find sites that linked to my site during a certain time period? Say in the past 2 weeks or from March 1-March 15th ?
Competitive Research | | priceseo0 -
Why does the link analysis of my website say I have no links?
When I click on the "Link Analysis" tab it says my website has a domain authority of 1 and has 0's for every other category. When I run it in Open Site Explorer - it says I have a page authority of 51 with over 4600 links. My website also seems to be at a stand still over the past several weeks. Anyone know why the two Link Analysis is not showing anything? Thank you
Competitive Research | | tyler7560 -
Query for checking is a link to domain A already exists on domain B
Hi, I was wondering if anyone can help. I need to have a simple check where I have 2 domains, and I can check of there are any links from domain A to domain B. Does anyone what would be the best query for this and if you would use google, bing, yahoo or other SE. Many thanks
Competitive Research | | James770 -
Website analysis automation
I need a tool that will input a list of URLs and produce a spreadsheet with link metrics for all sites including PageRank, Domain Authority, Page Authority, Social data, etc..i know that OSE will do this for 5 sites at a time but I need to compare more. At lest 50 at a time... I bought Buzzstream thinking this would work, but it doesn't. does anybody have any good advice? Thanks!!
Competitive Research | | znotes0