undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • SEO Q&A

      Insights & discussions from an SEO community of 500,000+.

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Local SEO
  4. Is there a way to get a list of urls on the website?

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Is there a way to get a list of urls on the website?

Local SEO
4
4
3.5k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • SeobyKP
    SeobyKP last edited by Dec 26, 2019, 8:17 PM

    For example, www.laskeimages.com

    Outside of Google Search Console, is there another way?

    1 Reply Last reply Reply Quote 0
    • WebQuest
      WebQuest Subscriber last edited by Dec 30, 2019, 4:52 PM Dec 30, 2019, 4:52 PM

      You can run a "site:yourwebsite.com" search on google and see what is returned.  Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.

      A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.

      1 Reply Last reply Reply Quote 0
      • Cobblerocks
        Cobblerocks last edited by Dec 29, 2019, 3:17 AM Dec 29, 2019, 3:17 AM

        slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc

        1 Reply Last reply Reply Quote 0
        • seoelevated
          seoelevated Subscriber last edited by Dec 26, 2019, 9:12 PM Dec 26, 2019, 9:12 PM

          If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.

          The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at  www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.

          Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.

          1 Reply Last reply Reply Quote 2
          • 1 / 1
          1 out of 4
          • First post
            1/4
            Last post

          Got a burning SEO question?

          Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


          Start my free trial


          Browse Questions

          Explore more categories

          • Moz Tools

            Chat with the community about the Moz tools.

          • SEO Tactics

            Discuss the SEO process with fellow marketers

          • Community

            Discuss industry events, jobs, and news!

          • Digital Marketing

            Chat about tactics outside of SEO

          • Research & Trends

            Dive into research and trends in the search industry.

          • Support

            Connect on product support and feature requests.

          • See all categories

          Related Questions

          • hopseq

            How to speed a website which government demands a popup of age restriction to display

            Hi team, Im running a website, which is related to Online Vape shop and I have some confusion regarding the core web vital algorithm.  However, the Government of the USA is very strict for this kind of topic and we should have to display the age restriction popup for those new users who enter the website: https://ashvapesmoke.com/ Can anyone tell me how to speed up the website, as if the website has this kind of popup mandatory guidelines from the government.  Google is launching a new core update related to speed in the may 2021 right? So if we add this kind of banner popup and all In the website, how we can get away from the issues. Please clarify to me, anyone, ASAP.

            Local SEO | Aug 10, 2024, 8:22 AM | hopseq
            0
          • HubMDP

            Should you set an hreflang if the website is only in one language

            We have a website, which is written in British English. There are no other versions of the site in different languages and the website only serves a UK audience. We have not set an hreflang tag up. Is this something we would still need to do and what would the benefits (if any) be?

            Local SEO | May 14, 2018, 9:36 AM | HubMDP
            0
          • paulfoz1609

            One website or multiple websites

            Im going round in circles with the best way to go about marketting my business from an SEO and usability stand point.  My company specialise in self adhesive films and vinyls which give us quite a varied niche. Our main areas are: Window films and interior vinyls such as printed wallpaper, wall coverings, furniture wraps etc for homes and businesses - For this area we cover nationwide Automotive films such as car window tinting, car and van wraps and paint protection films - for this we need the vehicles bringing to us so this is a more local are (around 20 miles of us max) Signs and graphics - anything from office signs, pavement signs to printed banners - these are all commercial and we go to the customer.  For this its a new side to the business and Id say wed look to go withing 50 miles of our base. My dilemma is, firstly when pushing social media etc we have a real divide for who we target as we have the home owers and business owners on one hand and then car enthusiasts on the other.  Also from an SEO point of view theres the local vs nationwide aspect.  A few people I have spoken to have said trying to target local for some services and national for others may be a little problematic. I have some people saying have all services under one domain as the links back to the site and content will all help the site to rank better.  This sounds logical to me. But then Ive had other people saying split the site into 2/3 sites.  Definitely split the automotive which is local from the other national areas as these are also going to be a different audience 9car enthusiasts vs home/business owners).  It will mean doing two lots of SEO but the sites will be more focused on the target audience and we can have one tagret local search and the other national. This too seems very logical. My gut feeling is that both options are sort of right but doesn anyone have any advice that could help me figure this out. Also to make things a little more complicated we have an ecommerce side were we supply goods direct to the public.  Woudl I be better to have a fresh domain which is simply an ecommerce platform or have a seperate shop section on my main domain were people can go to buy the products if they dont want us to fit them?

            Local SEO | Jun 21, 2017, 7:08 PM | paulfoz1609
            1
          • DJ1027

            Should I Split Into Two Websites?

            I'm creating a website for a new company that offers several related services. They want to have a main corporate website that has pages for all their services. However, they want to have a second website that only features a subset of those services. So they would have the same company name, same website template, but the smaller site would have a different domain name, different text/photos on the home page and be missing some pages from the main corporate site so that site would make them look more specialized. They would have separate marketing materials (brochures, business cards) that would have the website address and email address using the different domain name. They also want the smaller second site to come up on search results related to the services for that site and not the main site. Can this be pulled off without having a significant negative effect on ranking potential for either of the two site and also not risk a duplicate content penalty? It would seem you would have to add a robots.txt file that excludes indexing of the pages on the main site that are duplicating on the smaller site. However there is a potential big issue. The company is a local business. Nowadays the local results (Map + 3-pack) are as important if not more important, than the traditional organic results below the 3-pack (although I acknowledge they are related). For their Google Business Places, since they have two websites for the same company, they can only list one of the website. So if they list the corporate site, their not going to get in the local 3-pack for their specialized site for search terms. They may be able to live with this though since the main site will show ALL services. Comments? Ideas? Issues? Strategies?

            Local SEO | May 12, 2017, 5:37 PM | DJ1027
            0
          • sfrediktru8

            Local SEO Website Structure.

            Hi everyone, This might be quite a long post so please bear with me. I am currently rebuilding my website.  My previous website was built by a web designer and was very basic.  5 page html site consisting of home, services, gallery, testimonials, contact pages.  None of them were great - thin content, not optimised as well as could be - no h1's etc. To be fair I knew nothing about websites and didn't bother much with the site.  As a new business I used it simply as a place for people to visit for more information after receiving a leaflet and never bothered much about driving traffic to the site. A few years down the line and I have realised I need the website to be working for me as opposed to alongside me.  I am building it myself via wordpress as web designer didn't want to work in wordpress.  I have done my keyword research and I'm working on pages as we speak. Previously my homepage - around 80% of visitors landed here for my main keyword (driveway cleaning glasgow) as it was number 6 in the organic listing.  With my services page appearing directly underneath in 7 for the same keyword. I have starting building a new page for that keyword which contains (driveway-cleaning-glasgow) in the url. I have 301'd my previous services page to this url. Now for my questions...
            My 2nd keyword based on volume is driveway cleaning.  How do I optimise for this or will the (driveway-cleaning-glasgow) page rank for this also as the words are contained within this page? I plan on having the same structure for the remaining services - pressure-washing-glasgow, monoblock-cleaning-glasgow etc, etc.   As I am building new pages for each service with location built in, where does this leave my homepage?  Should I be targeting keywords for this page?  It is still my strongest page and apart from the (driveway-cleaning-glasgow) page which will get some help from the 301 these are all new pages so I would expect perhaps initially to lose some traffic.  But as I am not ranking well for anything other than the main 2 keywords mentioned above it can only be beneficial long term when google recognises the specific pages for each service.  And when I start using Adwords I will have a specific landing page for each service. Any advice would be appreciated. Thanks

            Local SEO | Jun 7, 2016, 5:41 PM | sfrediktru8
            0
          • KempRugeLawGroup

            How to find best local websites?

            For example, I'd like to type in a zipcode and get the highest ranking websites by DA/whatever metric the software uses, within a 25 mile radius? Does that type of service exist? I'm looking to build up our local links, but most of the websites have extremely low authority. I'm trying to find some good ones without having to manually check each one. Thanks, Ruben

            Local SEO | Nov 17, 2015, 9:38 PM | KempRugeLawGroup
            1
          • AL123al

            Two websites, same business name, same NAP

            Hi, A client of mine offers loft conversions and wants to make a go of it. So he has a website dedicated to loft conversions. He is also a joiner/carpenter and has another old website which offers general joinery work and insurance work. Both websites have the same business name and same address and phone number. There is only one Google place page for the loft conversions website. The loft conversions website is not ranking as well as we would like locally. Could it be due to the same NAP? What are the best options? Redirect the old website to the loft conversions one (he might not like that idea) Change the address and phone number on one website?(and all subsequent citations?) Would love some help on this!

            Local SEO | Aug 28, 2015, 4:07 PM | AL123al
            0
          • Mark_Ch

            How to remove countries viewing my website

            Hi All, I operate from the UK only. How can I exclude select countries from viewing both my organic website and Google Adwords listing. Organic Website
            Are the any free online services that give you a simple click + download/view script to cut & paste into a .htaccess file. Google Adwords
            Ditto as above with the exception to paste the IP list into Campaign | Setting Tab | Advanced settings - IP exclusions Thanks Mark

            Local SEO | Mar 26, 2014, 1:10 PM | Mark_Ch
            0

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy

          Looks like your connection to Moz was lost, please wait while we try to reconnect.