Indexed sites
-
Hello I´m a newbie here on seomoz. My question is just simple but i need to be sure about that:Refering to the report which you can create in the "crawl diagnostic summary". Does the CSV export lists all and ONLY the URLS which are in the google index?If not: does a report is available where all and ONLY the URLS are listed which are in google index?Many thanks! Henrik
-
Hi Henrik,
Like Tom and Chris mentioned, our tools won't be able to tell you which of your pages are indexed by Google.
That being said, the crawl diagnostics will tell you if your redirected pages are reachable by search engines and OSE will tell you internal and external links. OSE is updated every few weeks so it might not show your most recent changes. Using a combination of your campaign crawls and OSE should be able to get you the data that you need to make sure you're in the best position for your site relaunch.
Hope this helps and good luck with relaunching your site!
Best,
Sam
Moz Helpster -
Use your OSE report to find pages that are being linked to from external sources and be sure to redirect all of those. Use your analytics report to find pages that are bring in search traffic and be sure to redirect those. The rest are neither being linked to nor bringing you any traffic so their priority is on the low end, anyway.
-
thanks for your answers, my question was more to get a full report with sites which are indexed by google. I´mgoing to make a relauch soon. In the new website i changed a lot of categories and URL´s. Now I want to make sure that all sites which are indexed are redirected to the new URL with 301. It would be very helpfull to have a file whith ALL Urls which are indexed by google now.
-
Hi goodcat, you'll see from the FAQs on this page http://www.seomoz.org/help/crawl-diagnostics that the report data is from seomoz's crawl. Your question was asked and some answeres provided not too long ago over here: http://www.seomoz.org/q/is-it-possible-to-get-a-list-of-pages-indexed-in-google.
-
Hi Henrik
I have just checked this for you and yes, SEOMoz will show you URLs that have been deindexed by Google. As proof, here is a URL that contains a link to a site I've worked with that has come up in the SEOMoz crawl, but you will see has been de-indexed by Google (as has the whole domain):
http://www.doublebitbd.com/otherservices.htm
I'm not sure if there is a tool that will show you links that only exist in the Google index, I'm afraid, although I could be wrong. I do know a tool that will tell you which links pointing to your website have been deindexed and that is the LinkDetox tool. It will show you which links on your site are "toxic", meaning the URLs they sit on have been deindexed. The remaining links will be ones that point to your website.
You could also export the URLs in the SEOMoz report and put them into this IndexCheckingTool. Not sure how accurate it is, but if it gives you URLs that are noindexed from your Moz list, you could manually filter them out.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to deal with auto generated pages on our site that are considered thin content
Hi there, Wondering how to deal w/ about 300+ pages on our site that are autogenerated & considered thin content. Here is an example of those pages: https://app.cobalt.io/ninp0 The pages are auto generated when a new security researcher joins our team & then filled by each researcher with specifics about their personal experience. Additionally, there is a fair amount of dynamic content on these pages that updates with certain activities. These pages are also getting marked as not having a canonical tag on them, however, they are technically different pages just w/ very similar elements. I'm not sure I would want to put a canonical tag on them as some of them have a decent page authority & I think could be contributing to our overall SEO health. Any ideas on how I should deal w/ this group of similar but not identical pages?
Moz Pro | | ChrissyOck0 -
Duplicate Site Content found in Moz; Have a URL Parameter set in Google Webmaster Tools
Hey, So on our site we have a Buyer's Guide that we made. Essentially it is a pop-up with a series of questions that then recommends a product. The parameter ?openguide=true can be used on any url on our site to pull this buyer's guide up. Somehow the Moz Site Crawl reported each one of our pages as duplicate content as it added this string (?openguide=true) to each page. We already have a URL Parameter set in Google Webmaster Tools as openguide ; however, I am now worried that google might be seeing this duplicate content as well. I have checked all of the pages with duplicate title tags in the Webmaster Tools to see if that could give me an answer as to whether it is detecting duplicate content. I did not find any duplicate title tag pages that were because of the openguide parameter. I am just wondering if anyone knows:
Moz Pro | | MitchellChapman
1. a way to check if google is seeing it as duplicate content
2. make sure that the parameter is set correctly in webmaster tools
3. or a better way to prevent the crawler from thinking this is duplicate content Any help is appreciated! Thanks, Mitchell Chapman
www.kontrolfreek.com0 -
Having 1 page crawl error on 2 sites
Help! A few weeks back, my dev team did some "changes" (that I don't know anything about), but ever since then, my Moz crawl has only shown one page for either http://betamerica.com or http://fanex.com. Moz service was helpful in talking about a redirect loop that existed, and I asked my team to fix it, which it looks to me like they have. Still, 1 page. I used SEO Book's spider tool and it also only sees 1 page, and sees the sites as http://https://betamerica.com (for example), which is just weird. I don't know enough about HT Access or server stuff to figure out what's going on, so if someone can help me figure that out, I'd appreciate it.
Moz Pro | | BetAmerica0 -
How often does seomoz crawl the site? Can you force a crawl at a specific time ?
How often does seomoz crawl the site? Can you force a crawl at a specific time ?
Moz Pro | | stewbuch18720 -
Can open site explorer miss incoming links?
In open site explorer I only see one linking domain, eventhough I know of at least 1 other. Why is that?
Moz Pro | | ResourceLab0 -
My domain authority is 1, and I am not seeing any links to my site.
I know that there are links to my site, but nothing shows up. My website is www.mullinsgeoffrey.com. I have tried with and without the www. I am using wordpress for this site, but competitors are as well, and there authority seems fine. is there a hidden setting somewhere that is screwing things up?
Moz Pro | | mullinsgeoffrey0 -
Is the Linkscape Index getting updated?
I know it only gets a big refresh once a month...The last being in the early part of January. But I released a map that went viral (front page of CNET, Wired, Scientific American) that has gotten me hundreds of links from different domains: https://www.google.com/search?q=perceptionbuilder.com+map I got these links in early to mid December and OSE is showing no data at all. Similarly, I have been doing some linkbuilding for clients and links that I got in October and November and those links aren't showing up either. Anyone else experiencing this? Many thanks, Matt
Moz Pro | | coppersix0 -
How is a site really ranking when taking into account Google places?
When I do a rankings search for one of my sites on Google and it appears high in Google places, SEO Moz tracks this as its ranking - but is this its organic ranking? My clients are wondering if things have changed and so am I? Does ranking in the Google places/map appearing on front page of google count as your ranking for that keyword? Client keeps ignoring the Google places ranking and goes looking for a placement farther down... Please explain this probably simple question to me... and if you have official Google references for this, please include them. I appreciate it a lot... be blessed ben
Moz Pro | | creativeguy0