Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Any tool to get all the old or archived links of a website?
-
Hi all,
We can see the old pages/links of a website using web.archive.org. But we need to manually check all the cached versions to know those. Is there anyway to get all those links/pages?
Thanks
-
This first method is a complete guess if it just went down you might have a chance of grabbing the rest on google of it by typing in sight:thedomain.tld in google I don’t know how old this thing is so it’s a possibility.
Try http://archive.is Or time-travel.mementoweb.org
http://archive.is/20130504233657/http://moz.com/
You can find just links or html useing
http://www.internetfrog.com/mywebsite/archive/ with archive.org
Try when in The way back machine take the code and use Regex to grab the URLs
Use this inside of archive.org.
https://regex101.com/library/V36Bah
https://regex101.com/r/V36Bah/1
https://regex101.com/r/fbX1LZ/1
http://network.ubotstudio.com/forum/index.php/topic/12459-regex-explained-match-extract-urls/
https://mathiasbynens.be/demo/url-regex
Use google search inur:thedomain.tld any variation that you think will get your URLs
you never know what you might find.
The site Get data from any link tools like Majestic, Ahrefs, Moz OSE that will give you a outline of site structure if it was Crawl and I had a lot of back links you can get a lot of URLs that way.
One thing you have to do with the way back machine or archive.org. This simply use whatever page they have and click on that look for the site special by going to the homepage and trying to save that . So you can grab the URLs out of the navigation outside of that and doing Google searches for anything depending on how old it is it may still be there I don’t know how long ago this occur? But Google is not going to be a bad place to look. After that going to Webmaster to look for a xml site map or anything you could have useed To crawl the website prior to it coming down. If you know ran a crawl via Moz, screamingfrog or Deep Crawl you’re in luck. call the hosting if you own the domain
Are you the new owner? If you are there might be a small chance the hosting company or the old owner had a back up of the entire site never know but you need to ask.
I wish you all the very best
sorry about the formatting I’m on my cell phone
tom
-
I can't think of a better alternative then the one you're already using. It depends a bit on your use case, if it's just about links you might be able to get some historical data from Majestic but that's probably not matching your intent.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved IP Address Indexed on Google along with Domain
My website is showing/indexed on Google search results twice, with IP address and domain name
Other SEO Tools | | mupetra
I'm using AWS LightSail
I don't know how to fix this, beside I'm afraid this duplicate can harm my website0 -
Tool to Check Bing Index?
Anyone know of a tool to automate checking the Bing index? To check Google's index, I use URL Profiler but there is no option to check Bing.
Other SEO Tools | | Choice0 -
Google Analytics reports large amounts of out of state traffic
I've run into an issue where some of my clients are seeing large amounts of users in Analytics from outside of their markets. They only serve their local areas, so there should be a minimal amount of traffic from outside of them. I know that geolocation isn't 100% reliable, but these numbers are too far off to be categorized as simply being misidentified. Here are the important details: Over 48% of the traffic is listed as coming from outside of the state 62.77% of traffic is mobile, 28.95% desktop, and 9.28% tablet Of that, 23.73% is coming from an adjacent state, and of that, 82.41% is coming from one city - which is over 200 miles from the target city Several other clients that we manage also show large amounts of traffic coming from this same city, outside of their state or market The bounce rate from the target state is 52.82% - the bounce rate from the adjacent state is 67.41% Goal conversion rate is 19.43% in target state, 13.73% in adjacent state, and 15.79% in a far distant state - other states vary dramatically Analytics reports source/medium as primarily being facebook/cpc and google/cpc for out of state traffic, but both are set to only show ads to people in target state AdWords reports zero traffic from outside of target state, even though I can see the exact AdWords campaigns IDs in Analytics which tells me the traffic came from out of state Some Ad Groups listed in Analytics out of state traffic reports show zero clicks in AdWords I have spent a ton of time on the phone with AdWords support and they are giving me the runaround. They clearly know there is an issue, but keep saying that the data is accurate and that sometimes things are misidentified. They have no explanation for why so much traffic from CPC sources is being classified as out of state or why the AdWords and Analytics data aren't even close to matching. TLDR: Google Analytics shows thousands of users coming from paid sources outside of our target state; AdWords shows zero. Help appreciated!
Other SEO Tools | | unitednetworks0 -
Free proofreading tool
Does anyone use any free / open source profreading tool that not only corrects spelling, double-spacing and capital letters, but also meaning. Let's say it will tell you verb or subject is missing in the sentence. Or that a sentence doesn't make sense, such as 'Dog English he does looks well twelve'. Thanks. Katarina
Other SEO Tools | | Katarina-Borovska0 -
Which Meta Description Tool is the best??
I use Moz's title tag tool, as I've compared it against titles on Googles and it always correct. But I haven't found a good one for the description. I've tried the two below, but on occasions, they've gotten it wrong. Can anyone suggest a better one?? https://www.portent.com/serp-preview-tool http://www.seomofo.com/snippet-optimizer.html Thanks:)
Other SEO Tools | | MissThumann0 -
Google Analytics and Geotargeting a website for more than one country
Hi Google Analytics settings can geotarget to just one main location from what I can see. But is there a way to target the website to more than 1 location. The domain is currently a .co.uk so it is UK specific, and from my knowledge I understand that popular and well ranked pages in any country can rank outside of the geotargeted area. Aside from canonicalising new url's with relevant keywords, meta tagging new pages, and creating unique rich content tailored to countries is there anything else I can do, in your opinion? Thanks.
Other SEO Tools | | SEOguy11 -
Is there a tool to search for multiple allintitle:"keyword phrase"
Hi I wondering if there is a tool that can search multiple all in title exact keyword phrases searches say 250 - 300 terms at a time. I like to compare exact phrase search results to all indexed pages that google has indexed, trust me when I say It sucks doing this one at a time Marc
Other SEO Tools | | marcreece0