Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to speed a website which government demands a popup of age restriction to display
Hi team, Im running a website, which is related to Online Vape shop and I have some confusion regarding the core web vital algorithm. However, the Government of the USA is very strict for this kind of topic and we should have to display the age restriction popup for those new users who enter the website: https://ashvapesmoke.com/ Can anyone tell me how to speed up the website, as if the website has this kind of popup mandatory guidelines from the government. Google is launching a new core update related to speed in the may 2021 right? So if we add this kind of banner popup and all In the website, how we can get away from the issues. Please clarify to me, anyone, ASAP.
Local SEO | | hopseq0 -
Website Domain Redirection- Rebranding Issues
I have a website domain redirection query At the moment because of rebranding and domain changes I havehttp://www.physioinqnepean.com.au redirecting to http://www.nepeanphysiohydro.com.au/.http://www.nepeanphysiohydro.com.au/ is the primary domain because at the time I wanted to appease any SEO ramifications that might’ve occurred if I had the new domain at the time “http://www.physioinqnepean.com.au” as the primary domain.Unfortunately, my client now wants to rebrand AGAIN with the new website domain being “http://www.physioinqpenrith.com.au”.I wanted to gauge what would be the best SEO practice in relation to what domain should be the “Primary domain"?
Local SEO | | JD261 -
How Can I Get more traffic for me own blog ?
Hello guys I have my own blog called Hero-t3ch ,How can I get more traffic ??
Local SEO | | mohamednabil0 -
Will I get Penelized for having a .co.uk site AND a .com site?
Hi Mozers, I have a very important pitch coming up which needs to tackle a questions about international SEO. My client currently has a .com website, but we are debating internally about creating a .co.uk website too so that we can localise content for the UK versus American English on our .com site. Currently, our clients proposition is global, so we made the decision to create a .com website but using American English spelling as a large chunk of English speakers in the world use American English over British English. However, we want to grow the business within the UK, and therefore want to use British English language. Hence creating a .co.uk website. Now, my question is this.... the new .co.uk website will be identical content as the .com website, except for a few spelling changes and the way we phrase certain sentences. How would we be able to run both a .co.uk site and .com site without being penelized from Google for plagarism? Would it involve href lang tags? Server hosting location? Any ideas from you guys out there?
Local SEO | | Virginia-Girtz0 -
If I kill off the franchisee websites and create a corp SEO monster...will my Company's SEO suffer? Pros and Cons?
Our 25 franchisees sell one product of our 7 within the Corporate porfolio. We getting ready to release a brand new corp website employing all the best possible SEO practices. Since the franchisee's barely maintain their 3-page website...we are thinking of killing them off. We will create some market pages on the Corp side and continue to use HubSpot to pass along leads to the individual franchisees. Corporate has robust Content Marketing strategy in place. Any suggestions? Cases studies?
Local SEO | | Joseph.Lusso0 -
Local SEO Website Structure.
Hi everyone, This might be quite a long post so please bear with me. I am currently rebuilding my website. My previous website was built by a web designer and was very basic. 5 page html site consisting of home, services, gallery, testimonials, contact pages. None of them were great - thin content, not optimised as well as could be - no h1's etc. To be fair I knew nothing about websites and didn't bother much with the site. As a new business I used it simply as a place for people to visit for more information after receiving a leaflet and never bothered much about driving traffic to the site. A few years down the line and I have realised I need the website to be working for me as opposed to alongside me. I am building it myself via wordpress as web designer didn't want to work in wordpress. I have done my keyword research and I'm working on pages as we speak. Previously my homepage - around 80% of visitors landed here for my main keyword (driveway cleaning glasgow) as it was number 6 in the organic listing. With my services page appearing directly underneath in 7 for the same keyword. I have starting building a new page for that keyword which contains (driveway-cleaning-glasgow) in the url. I have 301'd my previous services page to this url. Now for my questions...
Local SEO | | sfrediktru8
My 2nd keyword based on volume is driveway cleaning. How do I optimise for this or will the (driveway-cleaning-glasgow) page rank for this also as the words are contained within this page? I plan on having the same structure for the remaining services - pressure-washing-glasgow, monoblock-cleaning-glasgow etc, etc. As I am building new pages for each service with location built in, where does this leave my homepage? Should I be targeting keywords for this page? It is still my strongest page and apart from the (driveway-cleaning-glasgow) page which will get some help from the 301 these are all new pages so I would expect perhaps initially to lose some traffic. But as I am not ranking well for anything other than the main 2 keywords mentioned above it can only be beneficial long term when google recognises the specific pages for each service. And when I start using Adwords I will have a specific landing page for each service. Any advice would be appreciated. Thanks0 -
Does having /search/ in your URLs for searches within your site hamper these URLs from coming up on Google SERP's?
We are an aggregate site for a particular category and have our own internal search wherein visitors can search for local references to services that they are looking for. We use SOLR search and our results page for the "Tag123" search would look like www.mywebsite.com/city/search/tag123 For some reason, we see that these pages are all indexed on Google but they do not come up on SERPs appropriately! The content is unique and we also have appropriate title and description tags on these pages.
Local SEO | | mycity4kids0 -
Content Across International Websites
I am wondering if anyone could clear up some questions I have regarding international SEO and how to treat the content placed on there. I have recently launched several websites for a product internationally, each with the correct country domain name etc and I have also followed the guidelines provided by webmaster tools on internationalisation. All the websites are targeted towards English speaking countries and I have rewritten most of the of the content on there to suite the English style of the targeted country. This is being said however I am finding mixed bags of information on what to do in treating large chunks of potential duplicate content. For example my main .com website which has been running several years (and is targeted to the UK) has a lot of well written articles on there which are popular with the visitors. I am needing to find out if duplicating these articles onto the international versions of the websites, without rewriting them, would have a detrimental effect on SEO between all the sites. I have done a site search for each domain name to see if they are cropping up in other local Google versions (e.g .ca site in Google.com.au etc) and they are not. Does this mean Google is localised to its results regarding duplicate content or is it treated at the root level? Any information to point me in the right direction would be a big help.
Local SEO | | Rj-Media0