Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
How can I make a list of all URLs indexed by Google?
-
I have a large site with over 6000 pages indexed but only 600 actual pages and need to clean up with 301 redirects. Haven't had this need since Google stopped displaying the url's in the results.
-
very depressed of being not indexing URL - https://www.wrightleatherworks.com/collections/gun-holsters-for-women please someone help
-
Open the sitemap in a text editor or XML viewer. Look at the <loc> tags in the sitemap file. These tags contain the URL of each page on the website. You can copy the URLs from the <loc> tags into a spreadsheet or text document.
-
Open the sitemap in a text editor or XML viewer. Look at the <loc> tags in the sitemap file. These tags contain the URL of each page on the website. You can copy the URLs from the <loc> tags into a spreadsheet or text document.
-
@aplusnetsolutions create a seperate sitemap for not indexed pages and upload to google web master tools. i had a website had same issues. Also remember it will take some time also
-
@aplusnetsolutions
Make sure all these things are selected in screaming frog and
-
Going to Google search console it will tell you how many inches are inside Google search index there are a few other ways to do this if you want
#1
By far the easiest is to going to search console and select coverage and all known pages
number 2
For the quick and dirty method, simply perform a simple site search in your Google search bar with “site:yourdomain.com”
#3
You can crawl your site using screaming frog (it will 500 pages for free but every SEO should have it) use it to index your site and connect it to Google search console API as well as Google analytics and you will have a easy-to-read CSV export of your index and non-index pages
more on how this is done
image url)video https://youtu.be/iYeXSdUt_hg
#4
or indexer site with any thing that can export a CSV download the CSV uploaded here and it will tell you which pages are in Google's index
https://www.rankwatch.com/free-tools/google-index-checkerhttps://searchengineland.com/check-urls-indexed-without-upsetting-google-follow-267472
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I check my website is not in spam?
I have a blogging website where I post about famous food, home remedies, and more. When I started my website's keywords were ranking on Google But Now a single keyword is not in the ranking list. That's why I have concerns about how I can fix it.
SEO Tactics | | worldviajar.com0 -
Should I redirect or add content, to 47 Pages?
We have an insurance agency website with 47 pages that have duplicate/low content warnings. What's the best way to handle this? I'm I right in thinking I have 2 options? Either add new content or redirect the page? Thanks in advance 🙂
On-Page Optimization | | laurentjb1 -
Google not listing website correctly
have a domain that was unused for a while and displayed the "parked by Gandi" domain message. Recently, I decided to set up a fully working website on that domain, but I'm struggling to get it to rank correctly on Google. Google isn't updating the http://domain.com to the correct https://www.domain.com, and I have tried everything. The http://domain.com redirects to https://www.domain.com if you click on it. I managed to get the correct version, https://www.domain.com, to show up, but after a couple of days, it reverted to the old version and has stayed that way. This has been going on for a few weeks now. Additionally, I had an old version of the site using .com, and I forwarded that to the .co.uk, but the old .com will not be removed from Google. it was just one page without much content. At the moment, Google's search results look very messy and out of date. I have submitted the URL in the Google Search Console using the URL inspection tool and requested indexing and reindexing. I have also submitted sitemaps, but nothing is really working. Any ideas?
SEO Tactics | | Roycd0 -
Google search console 380,000 spam backlinks
Hi guys, I recently suffered a major negative seo attack against my site, with more than 380K spam backlinks using more than 5k domains. Because of this, I'm having serious problems tracking my site's statistics in GSC due to the limit of only 1000 query lines. Please, I need help on how I can get access to all these 5,000 domains in the search console so I can create a disavow list. Any tips on how to clean this up?
SEO Tactics | | xurupita0 -
Google is ranking only home page not even considering to rank other pages!
Hey Community! I am facing an ranking issue, I am trying to rank on multiple quires with my sub-pages. The issue is homepage is ranking on every single query. Even the homepage's content is not relevant to that query! I have made sure to remove any sort of content relevancy from homepage which i trying to rank with my sub-pages. Business/Website Details: We are a recruitment agency based Pakistan providing manpower around the globe and other recruiting services. We are targeting each country with a sub-page. Even after I have done some necessary things but still there is not effect on rankings. Let me share some examples: Query: recruitment agency for gulf in pakistan Home Page Showing
SEO Tactics | | xShams
1.jpg Page i want to ranking:
2.jpg This issue is not only with this page, it's appearing on multiple quires but I think it should clear the issue I am facing. Now: Any Possible Solutions to this technical or ranking error. Backlinks on this query don't matter because you can check the other search results don't have any backlink data on them. Please share some quick thoughts on-page content. Even I make a page that have the word recruiting/recruitment in it google will automatically rank homepage and not the page i want! Thanks in advance for help 🙂0 -
Unsolved Google is ranking me #1 singular but not plural
Hi all, I am facing an ranking issue, I am trying to rank on a query:
SEO Tactics | | xShams
"Recruitment Agencies In Pakistan for Saudi Arabia" Google is ranking me correctly #1 in singular version on the query, but not in plural version. Even my competitors in SERP's are same and ranking correctly on both teams. And yes, the real/in-search keyword is ""Recruitment Agencies In Pakistan for Saudi Arabia" and not the "Recruitment Agency In Pakistan for Saudi Arabia" I have gone through my on-page and off page but sill can't find the solution. Here is the image of current SERP's: "Recruitment Agencies In Pakistan for Saudi Arabia"
1.jpg "Recruitment Agency In Pakistan for Saudi Arabia"
2.jpg Can anyone please guide me on this, like what should i do?0 -
Google Not Indexing Pages (Wordpress)
Hello, recently I started noticing that google is not indexing our new pages or our new blog posts. We are simply getting a "Discovered - Currently Not Indexed" message on all new pages. When I click "Request Indexing" is takes a few days, but eventually it does get indexed and is on Google. This is very strange, as our website has been around since the late 90's and the quality of the new content is neither duplicate nor "low quality". We started noticing this happening around February. We also do not have many pages - maybe 500 maximum? I have looked at all the obvious answers (allowing for indexing, etc.), but just can't seem to pinpoint a reason why. Has anyone had this happen recently? It is getting very annoying having to manually go in and request indexing for every page and makes me think there may be some underlying issues with the website that should be fixed.
Technical SEO | | Hasanovic1 -
When to re-write and redirect a blog url?
What are best practices for rewriting (and then redirecting) blog URLs? I refresh old blog posts on our blog every month and many of them have URLs that are too long or could be improved. However, many of them also already get decent organic traffic and I don't want to lose traffic due to a URL redirect. Are there any best practices or "rules" I can follow when deciding whether to re-write and redirect blog URLs?
Content Development | | Emily.R.Monrovia
Thanks!0