Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rankings preferring English URL
We've recently had a redesign of our website and we have both a Dutch and an English version. However, in MOZ for both NL and BE-NL it seems to favor the English URLs. This never used to be the case and I'm wondering why it's happening and whether it could actually be hurting our SEO, as search engines would favor local languages for search queries.
Local SEO | | Billywig0 -
Should you set an hreflang if the website is only in one language
We have a website, which is written in British English. There are no other versions of the site in different languages and the website only serves a UK audience. We have not set an hreflang tag up. Is this something we would still need to do and what would the benefits (if any) be?
Local SEO | | HubMDP0 -
Should we get an Australian TLD?
We are launching a product in Australia which is already available in the UK. We currently have the .co.uk but the .com is not available. How important would it be to get the Australian TLD? I am interested in hearing from people who have knowledge of the Australian market to understand how they would feel about buying from a .co.uk. I know the US market wouldn't be keen to buy from a .co.uk, so would be interested to know if the same would be true of Australia. The product is a crafty mum to mum product, invented by a UK mum and that is part of the appeal, which may make the UK domain more palatable? The client has a small budget and low profit margins so creating a whole new website could be prohibitative. So I am keen to go down the route of a sub-directory targeting Australia if possible. Thanks in advance
Local SEO | | Wagada0 -
If I kill off the franchisee websites and create a corp SEO monster...will my Company's SEO suffer? Pros and Cons?
Our 25 franchisees sell one product of our 7 within the Corporate porfolio. We getting ready to release a brand new corp website employing all the best possible SEO practices. Since the franchisee's barely maintain their 3-page website...we are thinking of killing them off. We will create some market pages on the Corp side and continue to use HubSpot to pass along leads to the individual franchisees. Corporate has robust Content Marketing strategy in place. Any suggestions? Cases studies?
Local SEO | | Joseph.Lusso0 -
How should i Get Max Traffic To my website
Hello Dear Moz friends, I am New to This Forum, I just Want to ask How should I get maximum traffic to My website??
Local SEO | | falguniwpi
As i Have done All The things Correct, But i am Not getting Good traffic To my website, Posted on Forums, regular facebook posting, G+, But Still i am Not Getting good visitors to my website. Please Suggest me some Good Traffic Generation Sources, Thank you0 -
302 redirection from .com to .in. Google is indexing both urls
Hello Fellow members, I am sharing the problem what I am facing from client which is another division of my company ( taking as a client). Please recommend me a full proof solution. My client runs a fashion e-commerce site by .com domain in India but after 2 years they took decision that in India, only .in domain site would run with INR prices & outside in "$" prices. Now when If someone is searching with .com domain in India site is 302 redirecting into the .in domain. In India only .in site is working & outside .com but Google is indexing pages of both sites. With .com domain 5 lakhs + pages are indexed & from .in domain only 2600 pages. Content of both sites almost 95% same. I already recommended to put rel=canonical tag on both sites but this is not the permanent solution. They have started .in domain to show prices in "$" & "INR" only. Can you recommend me the best possible answer to solve this issue.
Local SEO | | sourabhrana0 -
How to find best local websites?
For example, I'd like to type in a zipcode and get the highest ranking websites by DA/whatever metric the software uses, within a 25 mile radius? Does that type of service exist? I'm looking to build up our local links, but most of the websites have extremely low authority. I'm trying to find some good ones without having to manually check each one. Thanks, Ruben
Local SEO | | KempRugeLawGroup1 -
Meaningful analytic benchmarks and insights for 100+ websites?
Hey all! I work for an association that has over 100+ member businesses. These businesses are dispersed through out North America and each have their own website, totally independent of each other in look, feel, functionality, etc.. While most of these businesses offer the same core businesses such as a gym, summer camp and preschool, none of the website structures, calls to actions, etc. are the same. I have a feeling that there could be some interesting and meaningful analytics that I could pull together if I had access to all their Google Analytics accounts, but I'm not quite sure what they would be. Some ideas I have - 1 - Percentage of traffic from social media - will give insight as to which businesses in the association are using social successfully. 2 - New vs. Returning traffic - a high percentage of returning traffic might be indicative of more useful websites. 3 - Mobile usage - How mobile savvy are the customers of different businesses in the association. Any other analytics (and quite frankly, more meaningful/impactful than the ones I posted above) that you guys can think of? Thanks for your help! Chris
Local SEO | | JCCA1