Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should you set an hreflang if the website is only in one language
We have a website, which is written in British English. There are no other versions of the site in different languages and the website only serves a UK audience. We have not set an hreflang tag up. Is this something we would still need to do and what would the benefits (if any) be?
Local SEO | | HubMDP0 -
Two websites or a sub domain or sub page?
Hi, Our company has three branches in Canada and opening a 4th in the United States soon. Our target market strategy will differ in the States and I would like to know your opinion if we should launch a second site under a slightly different brand or not. I don’t want to do anything that could negatively impact our site’s current organic ranks. I feel I have to give some history on our company so you understand the dilemma. It is a little complicated. So, in Canada, we rent large generators and all the equipment needed to distribute and transform that power. We don’t own the generators. We re-rent generators (broker) from our partners. What we own is all the distribution equipment that typically accompanies a generator rental. We make money on the generator also, but the real money is in the distribution portion. In terms of messaging, our current site is tuned to target the end-user, the same market that our re-rent partners target. As a result, our re-rent partners and our company will bid on the same project in many occurrences. Our strategy in the United States is to primarily target the re-rent market. That is a very small segment in comparison to the end-user. From a marketing perspective, all that is really needed to target that group is an outside sales team. There are maybe 40 re-rent partners we will target in our first U.S. GEO… Texas. In the States, we will not rent generators. We will not run ad campaigns that bid on any generator rental type terms. We will not offer the same level of turn-key solutions we offer in Canada. All of the equipment we manufacture will be very generic in appearance, think Acme. Branding will look completely different than what we have up in Canada. We want the re-rent companies we target in the States to feel comfortable we are there to support them not compete against them. Regarding website strategy, I see three options: 1. We create a sub domain or sub page of www.trinitypower.com that explains the services we offer in the States. This for me is the safest solution. 2. We launch a second domain www.trinitypowerrentals.com that has similar content in-terms of the type of equipment we rent, but speaks directly to re-rent partners. That may not be enough of a differentiator though and I fear two sites owned by the same company with similar content will have negative SEO implications, if not right away, a year down the road. 3. We launch a new website under a completely different company name. This still carries some risk as I understand it, even if we have different phone numbers, company registration info, etc…
Local SEO | | TrinityPower
Would love to know your thoughts. Thanks everyone. J0 -
Will I get Penelized for having a .co.uk site AND a .com site?
Hi Mozers, I have a very important pitch coming up which needs to tackle a questions about international SEO. My client currently has a .com website, but we are debating internally about creating a .co.uk website too so that we can localise content for the UK versus American English on our .com site. Currently, our clients proposition is global, so we made the decision to create a .com website but using American English spelling as a large chunk of English speakers in the world use American English over British English. However, we want to grow the business within the UK, and therefore want to use British English language. Hence creating a .co.uk website. Now, my question is this.... the new .co.uk website will be identical content as the .com website, except for a few spelling changes and the way we phrase certain sentences. How would we be able to run both a .co.uk site and .com site without being penelized from Google for plagarism? Would it involve href lang tags? Server hosting location? Any ideas from you guys out there?
Local SEO | | Virginia-Girtz0 -
One website or multiple websites
Im going round in circles with the best way to go about marketting my business from an SEO and usability stand point. My company specialise in self adhesive films and vinyls which give us quite a varied niche. Our main areas are: Window films and interior vinyls such as printed wallpaper, wall coverings, furniture wraps etc for homes and businesses - For this area we cover nationwide Automotive films such as car window tinting, car and van wraps and paint protection films - for this we need the vehicles bringing to us so this is a more local are (around 20 miles of us max) Signs and graphics - anything from office signs, pavement signs to printed banners - these are all commercial and we go to the customer. For this its a new side to the business and Id say wed look to go withing 50 miles of our base. My dilemma is, firstly when pushing social media etc we have a real divide for who we target as we have the home owers and business owners on one hand and then car enthusiasts on the other. Also from an SEO point of view theres the local vs nationwide aspect. A few people I have spoken to have said trying to target local for some services and national for others may be a little problematic. I have some people saying have all services under one domain as the links back to the site and content will all help the site to rank better. This sounds logical to me. But then Ive had other people saying split the site into 2/3 sites. Definitely split the automotive which is local from the other national areas as these are also going to be a different audience 9car enthusiasts vs home/business owners). It will mean doing two lots of SEO but the sites will be more focused on the target audience and we can have one tagret local search and the other national. This too seems very logical. My gut feeling is that both options are sort of right but doesn anyone have any advice that could help me figure this out. Also to make things a little more complicated we have an ecommerce side were we supply goods direct to the public. Woudl I be better to have a fresh domain which is simply an ecommerce platform or have a seperate shop section on my main domain were people can go to buy the products if they dont want us to fit them?
Local SEO | | paulfoz16091 -
Correct setup: One business, one website, two bricks and mortar locations
Hi all, we have a furniture business with two physical stores and one website, which has the ability to sell online but we hardly sell anything but we're just about to start Google PLA on a few products, let's say our website is at: nicefurniture.co.uk We have nicefurniture.co.uk/first-location and nicefurniture.co.uk/second-location set up with all the store info, a Google Map, contact info, etc. This is linked to from the footer on all pages. Issue 1: I have been told conflicting things about how to best set up our Google My Business page. One person says set the URL for both to our homepage, nicefurniture.co.uk and the other says point each GMB listing to the store location pages OR we should buy www.furniture-first-location.co.uk as our URL and point the GMB listing to that. To me, that doesn't make sense as we'd be spreading our domain equity with a new domain, surely? Issue 2: How do I get each GMB location to show up in Maps, etc when people search for 'furniture location' or even 'sofa location' or 'dining table location'? Would I need to optimize the store pages on our site? Issue 3: Years ago we did set up another URL, let's say nicefurniture-cornwall.co.uk and on it there are about 500 pages, all with links pointing to our main website. Google Search Console for our main website lists this other website as one of our top linking domains. Does that mean if we remove nicefurniture-cornwall.co.uk we'll risk a drop in rankings? Many thanks for your input.
Local SEO | | Bee1590 -
How can you add custom Structured Data to a website hosted on Squarespace?
I have a client with a simple one page landing website hosted on Squarespace. Is there any method to easily apply structured data to this format?
Local SEO | | RosemaryB0 -
Two websites, same business name, same NAP
Hi, A client of mine offers loft conversions and wants to make a go of it. So he has a website dedicated to loft conversions. He is also a joiner/carpenter and has another old website which offers general joinery work and insurance work. Both websites have the same business name and same address and phone number. There is only one Google place page for the loft conversions website. The loft conversions website is not ranking as well as we would like locally. Could it be due to the same NAP? What are the best options? Redirect the old website to the loft conversions one (he might not like that idea) Change the address and phone number on one website?(and all subsequent citations?) Would love some help on this!
Local SEO | | AL123al0 -
Content Across International Websites
I am wondering if anyone could clear up some questions I have regarding international SEO and how to treat the content placed on there. I have recently launched several websites for a product internationally, each with the correct country domain name etc and I have also followed the guidelines provided by webmaster tools on internationalisation. All the websites are targeted towards English speaking countries and I have rewritten most of the of the content on there to suite the English style of the targeted country. This is being said however I am finding mixed bags of information on what to do in treating large chunks of potential duplicate content. For example my main .com website which has been running several years (and is targeted to the UK) has a lot of well written articles on there which are popular with the visitors. I am needing to find out if duplicating these articles onto the international versions of the websites, without rewriting them, would have a detrimental effect on SEO between all the sites. I have done a site search for each domain name to see if they are cropping up in other local Google versions (e.g .ca site in Google.com.au etc) and they are not. Does this mean Google is localised to its results regarding duplicate content or is it treated at the root level? Any information to point me in the right direction would be a big help.
Local SEO | | Rj-Media0