Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Selling on eBay and Amazon, does it have a negative impact our your website?
_We sell on multiple platforms I.e own website, eBay, Amazon and have noticed over the last few years to hold a page 1 ranking on Google is becoming more and more difficult as the SERPs are saturated with the big brands. _ My question is, we've loaded all of our products and there lovely unique descriptions to eBay and Amazon, is there any chance that this content is helping eBay and Amazon rank (may be not by much!), but certainly not doing us any favours. As effectively why would you show our site in the search results for a product range, when all of the content/products already appear on eBay/Amazon which is several SERPs places higher? Is Google not inclined to think, "hey no need to show x site, as the content is already features on Amazon, why show it twice?" Any one have any thoughts?
Competitive Research | | bnknowles10 -
Building a high-traffic website in a jobs-related domain
Hi, We are currently planning upon starting a website that’s targeted towards people looking for government jobs in India. Here are the primary / base keywords that we are targeting: Sarkari Naukri Government Jobs / Govt Jobs Latest Government jobs Banking Jobs Bank jobs Railway jobs Employment News IBPS SSC We’re confused that how should we go about ranking on top for these / long tail keywords around it? Because, we think that this is not a domain where you can write long and information-oriented posts (1400-1500 words) to crack SEO. People come to websites under this domain to look for latest jobs and that might or might not be around the high-traffic keywords mentioned above. Secondly, it might not be possible to write a lot of long & information-oriented content around these newer job posts. How do we go about building a high-traffic website in this domain? Thanks...
Competitive Research | | Shalin.TJ0 -
How can I track relevant websites my visitors are viewing?
I'm wanting to build a in-depth profile for my company's typical site visitor and I was wondering if there is anyway to view other websites that visitors are searching for online to get an idea of their hobbies/interests and how they spend their free time. I'm not sure if I'm asking the right questions in Google because the results are very broad and are more about reading analytics for your own company. Can anyone point me to a website or software that allows for this sort of thing?
Competitive Research | | CleanEdisonInc0 -
How does my competitor website jump from a natural ranking of 10 to 1 in a matter of days?
OK this has really got me baffled, and I really hope the MOZ community can give me the answers I am seeking.... My statements and queries below are my own opinions and thoughts. I am not an experienced SEOer and I am learning all the time, so if I have written something incorrectly, please feel free to correct me 🙂 I have been told that natural rankings take time, and I have read with the recent algorithm changes from Google, that purchased links do not have an effect like they used to. I have also read somewhere that google has clamped down on bogus article writing (MOZ please clarify) But what I am seeking some clarification on is, how does my competitors website, that has had a natural rank of #1 in the past, suddenly drop off; for a lengthy period of time, then suddenly re-appear at #10 on page #1, then some three/four days later, hit #1? I have read that natural rankings are purely natural. I.e. a domain owner cannot pay google to boost their natural ranking. But is this really true? Why is it when I speak to a close colleague of mine in the same industry, he mentions that his maps listing has dropped off, and after making a couple of phone calls to his SEO guys in India, maybe a day or two later, magically his maps re-appear? I really am starting to question is a "natural ranking" really "natural?" I have heard that some of these SEO agencies do have some tools that dramatically effect the natural ranking of a domain. What are these tools?
Competitive Research | | Giorgio680 -
Ecommerce Website Product Rich Snippet Image
Greetings Mozzers, I'm working on an ecommerce site and my goal is to have the product rich snippets on each of them however, I would like an image to start displaying in the SERPs. Looking for some guidance on this issue. Here is a well phrased questioned I found that sums up my thoughts: Product schema has the "image" attribute, but it is not displayed in rich snippets in SERP. However, there is recipe schema and it allows to show image directly on SERP. It means that we can define two entities on a page (product and recipe, it is allowed) and it should display an image from recipe's part + the rest of information (price, availability) from product's part. I know it is a dirty hack and semantically incorrect, but will it work? If so, would it affect rankings or not? Any other drawbacks? Thank you for any advice/clarification!
Competitive Research | | MonsterWeb280 -
Is there an SEO benefit to purchasing domains for a website?
Greetings Mozzers, I wanted to see if someone could clarify the power of domains for me a bit. Is there an SEO benefit in purchasing fresh domains for a specific website? Something that would effect certain metrics like parking keyword domains to pages that target that keyword? I'm not talking about buying pre-existing domains that have value and are for sale. I'm talking about newly registered domains. Thanks for any advice/clarification.
Competitive Research | | MonsterWeb280 -
Websites like these..
Hi, I'm new to link building. I have done some research of my competitors and have found that many of them are being linked to sites like this http://www.worldofwondersvu.com/ As you can see, this website looks like a business website, but if you view the content, it's spammed with external links. I'm just wondering what method they are going about to get these links, because most of the websites that are linking to them are simular to the one I posted above! Thanks 🙂
Competitive Research | | LTTVending740 -
Can i have chance to rank higher than official website in google local domains ?
Q : can i have chance to rank higher than official website in google local domains ? for example : rank higher than microsoft,kaspersky,nokia etc... in google italy or google germany or any other local domain for google
Competitive Research | | activeacts0