Is there a report I can run to get a list of all pages indexed by Google for my website?
-
I want to get a CSV file of all the pages that are indexed by Google and other search engines so I can create and .htaccess file of 301 redirects
-
If you only want your indexed pages, you can add the SeoQuake plugin to your browser than do a google search like site:http://www.yoursite.com/ . Be sure to chose "show with omitted results included". This search will show all the indexed pages of your site. From Google settings, chose 50 or 100 results per page and than, above the results, SeoQuake has an option to download as CSV.
Assuming that you don't have thousands of pages, save them from each Google results page and get them together in one file. Than, you can sort them out and do whatever you want to. Good luck!
-
Sorry, what I actually need is a list of the pages in my website that Google has already indexed.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
Domain authority get down significantly. Internal MOZ Issue? Google Algoritm Update?
I've noticed that several websites have lost DA since middle of october. I attached a picture. Could be this a MOZ internal issue like happened a time ago? Not only the DA get down, I have lost C-blocks links, too
Moz Pro | | NachoRetta
I check in http://health.moz.com/ and found this Crawl Services Outage: http://health.moz.com/incidents/fbn00m7xxzx2
But not appear to have direct relation with my question.
Or may be a google algoritm update? 3anVE5J.png2 -
Social pages not lining up with my website/listing
Hi! Newbie here... 🙂 On my Moz report and I have been told that my social sites are not lining up with my webpage. Any tips on getting this done? Also on my Moz Analytic report, I've added my social sites but only facebook is coming up... Any tips would be appreciated!!! Thanks!
Moz Pro | | fullerton0 -
Is www.domain.com/page the same url as www.domain.com/page/ for Google? (extra slash at end of url)
Dear all, in open site explorer there is a difference the url's 'www.domain.com/page' and 'www.domain.com/page/' (extra slash at end). There can be different values in pageauthority etc. in the open site explorer tool, but is this also the case for Google? Thanks for replying, Regards, Ben
Moz Pro | | HMK-NL0 -
Where can I upload my logo for custom reports?
Hi, I've read the custom reports FAQ and it said I can upload my logo for white labeling under campaign settings. I navigated to campaign settings but haven't found the place to upload my logo. Could you please help? Barnabas
Moz Pro | | Barna0 -
My trial ends on 2nd June. Can I cancel it on 1st or we need to initiate it before that , to not get charged ?
I need to cancel my trial. It ends on 2nd june as per seomoz. When can i cancel it exactly to avoid charges.
Moz Pro | | VarunBansal0 -
Can the link acqusition tool / web directory list be used for non-english language enquiries?
Hi there, We are currently in the trial period of seomoz pro and have been testing all of the availiable tools. We are very happy with OSE and the other professional tools however we have discovered a barrier in our research methods. 1, Does anyone know how can you use the link acqusition assistant for non-english enquiries? The suggested search queries that are automatically generated are "submit site" "submit url" etc, but this has almost no use for a non-english keyword. - Also are the results only displayed for google.com - is there no localization at all of search enquiries? 2, The list of directories provided by seomoz link: http://www.seomoz.org/directories are anglo-centric. What are the availiable options for non-english speaking directories / local directories NOT based in the United States? Any help that can be provided would be greatly appreciated!
Moz Pro | | deliveryhero0 -
Most of the time getting error.
Hi, i am getting this error most of the time in linkscape since last month. Sorry dude, no inlinks found matching this criteria. Pl guide is this a bug and the sites I am trying to use linkscape for were having lot of pages crawled earlier by SEOMOZ. Thanks, Preet
Moz Pro | | PreetSibia0