Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO newbie here - I cannot seem to find the direct answers to a few queries that I have
Hi, Apologies if these are very simple queries, but I cannot seem to find the answers anywhere. I understand meta keywords are pretty much pointless nowadays, however when I run a report on another 'keyword website' - my website only ranks for around 2k keywords where my competitors rank for much more (around 20k). I was just wondering where these keywords are found, as I can only assume that these are meta keywords? The company that I'm working on the SEO for is a holiday agency that specialises in holidays abroad for disabled people, so that means that we have a niche product/service and whilst we rank fairly high for some keywords, we would like to rank higher. How is it possible to work towards ranking higher for particular keywords? When doing keyword research 'disabled holidays' has a lot more search traffic than 'accessible holidays'. We are called Enable Holidays and our main competitors have the words 'disabled' and 'accessible' in their domain's, so I would imagine that it's going to be hard to potentially rank higher than our competitors for these keywords? Could someone put me in the right direction of how you improve rankings in the SERP for certain keyword searches? For example, do we have to write more content on a certain page about a keyword? Do we have to include more long-tail keywords in the content? Any help is appreciated. Thanks
Competitive Research | | enableholidays0 -
Why is my website not in the top 3 if our Moz statistics are better?
Hi, We've been using Moz, for our E-commerce sites, for some time now and are improving all of our statistics, be it on-page for specific keywords or general crawl errors, but I've not been seeing a lot of change in our rankings... (we've moved from place 7 to 6 on our main keyword). I'm thinking of looking at our backlinks, through Link Detox, after we finish our Moz optimisation to see if anything weird is going on with that. Are there any other areas I should be looking at? any other clues as to why we're not ranking higher than our competitors. Even if our Moz statistics are better and our Market Samurai values are similar? Thank you very much! Alexander
Competitive Research | | WebmasterAlex1 -
How can this website be ranking so well?!
This website: http://www.opensiteexplorer.org/domains?site=www.webuycarsyourway.com.au is ranking on page one for about 75% of a list of 300 car related keywords. They don't appear to have done any link building, no social media, appeared out of nowhere in April 2012 and SEMRush reports between 5,000 and 10,000 visitors per month. The only thing I can see is they have a landing page for every keyword with the keyword in the URL. But surely that can't be the only reason they're ranking well ? ?
Competitive Research | | eatyourveggies0 -
Why does the link analysis of my website say I have no links?
When I click on the "Link Analysis" tab it says my website has a domain authority of 1 and has 0's for every other category. When I run it in Open Site Explorer - it says I have a page authority of 51 with over 4600 links. My website also seems to be at a stand still over the past several weeks. Anyone know why the two Link Analysis is not showing anything? Thank you
Competitive Research | | tyler7560 -
How do I find my client's real competition?
A recently acquired client keeps insisting that his major competitors are online fashion magazines, fashion news sites and insider bloggers but the site he owns is basically a fashion encyclopedia. It contains facts and catalogues and even a dictionary of fashion concepts. According to me, these latter are his benchmarks and not his competition His major competitors, according to me. are people competing on the first SERP pages for terms like "fashion history", "fashion icons", "fashion biographies", etc. Am I right? How do I convince him that these are his real competition. This is really going to determine the direction of my keyword research.
Competitive Research | | amit20760 -
Website Neighborhood Tool
Hello,
Competitive Research | | Ric
Do you know a tool where you can find other websites with the same Adsense code or Analytics Code? Thanks, Eric0 -
Why does website rank? PA-39 DA-24
This website is pretty nice, well done. The few links they do have are nice and clean, from his brothers website, very much white hat. However, it appears that they aren't doing much of anything from an SEO standpoint. This site, is PA31 DA21 is also doing unusually well. In both cases, these guy are outranking the best know, most famous, and most trusted company in the industry who is PA84 DA81. This is a HUGE company that wins the most awards and gets tons of media coverage both in print and on televisiton shows. I'm also noticing that the websites that are ranking well in my niche (every keyword) all have the name of their company at the beginning of the title tag, those with the name of the company at the end of the title tag are consistantly a few ranks lower. This seems to be consistant across all search terms. My niche is highly competitive for a very low amount of traffic. Adwords is crazy expensive for some of these keywords! That said, one valid sale generates a significant amount of money. Would love to hear your thoughts. I'm thinking the first company is being treated so well becase G considers them to be virgins, the purist of white?
Competitive Research | | dmac0 -
Can i have chance to rank higher than official website in google local domains ?
Q : can i have chance to rank higher than official website in google local domains ? for example : rank higher than microsoft,kaspersky,nokia etc... in google italy or google germany or any other local domain for google
Competitive Research | | activeacts0