Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website Domain Redirection- Rebranding Issues
I have a website domain redirection query At the moment because of rebranding and domain changes I havehttp://www.physioinqnepean.com.au redirecting to http://www.nepeanphysiohydro.com.au/.http://www.nepeanphysiohydro.com.au/ is the primary domain because at the time I wanted to appease any SEO ramifications that might’ve occurred if I had the new domain at the time “http://www.physioinqnepean.com.au” as the primary domain.Unfortunately, my client now wants to rebrand AGAIN with the new website domain being “http://www.physioinqpenrith.com.au”.I wanted to gauge what would be the best SEO practice in relation to what domain should be the “Primary domain"?
Local SEO | | JD261 -
Two websites or a sub domain or sub page?
Hi, Our company has three branches in Canada and opening a 4th in the United States soon. Our target market strategy will differ in the States and I would like to know your opinion if we should launch a second site under a slightly different brand or not. I don’t want to do anything that could negatively impact our site’s current organic ranks. I feel I have to give some history on our company so you understand the dilemma. It is a little complicated. So, in Canada, we rent large generators and all the equipment needed to distribute and transform that power. We don’t own the generators. We re-rent generators (broker) from our partners. What we own is all the distribution equipment that typically accompanies a generator rental. We make money on the generator also, but the real money is in the distribution portion. In terms of messaging, our current site is tuned to target the end-user, the same market that our re-rent partners target. As a result, our re-rent partners and our company will bid on the same project in many occurrences. Our strategy in the United States is to primarily target the re-rent market. That is a very small segment in comparison to the end-user. From a marketing perspective, all that is really needed to target that group is an outside sales team. There are maybe 40 re-rent partners we will target in our first U.S. GEO… Texas. In the States, we will not rent generators. We will not run ad campaigns that bid on any generator rental type terms. We will not offer the same level of turn-key solutions we offer in Canada. All of the equipment we manufacture will be very generic in appearance, think Acme. Branding will look completely different than what we have up in Canada. We want the re-rent companies we target in the States to feel comfortable we are there to support them not compete against them. Regarding website strategy, I see three options: 1. We create a sub domain or sub page of www.trinitypower.com that explains the services we offer in the States. This for me is the safest solution. 2. We launch a second domain www.trinitypowerrentals.com that has similar content in-terms of the type of equipment we rent, but speaks directly to re-rent partners. That may not be enough of a differentiator though and I fear two sites owned by the same company with similar content will have negative SEO implications, if not right away, a year down the road. 3. We launch a new website under a completely different company name. This still carries some risk as I understand it, even if we have different phone numbers, company registration info, etc…
Local SEO | | TrinityPower
Would love to know your thoughts. Thanks everyone. J0 -
Building Press Release/News Distribution Lists
I'm currently setting up projects in Buzz Stream so that I can send out news tips and press releases to local news stations. Has anyone been able to do this successfully without signing up for an expensive press release distribution company like Newswire? If so... I would appreciate it if you could share an email template you use to send out your news tips and press releases to the local news stations. Thank you!!!
Local SEO | | LindsayE1 -
One website or multiple websites
Im going round in circles with the best way to go about marketting my business from an SEO and usability stand point. My company specialise in self adhesive films and vinyls which give us quite a varied niche. Our main areas are: Window films and interior vinyls such as printed wallpaper, wall coverings, furniture wraps etc for homes and businesses - For this area we cover nationwide Automotive films such as car window tinting, car and van wraps and paint protection films - for this we need the vehicles bringing to us so this is a more local are (around 20 miles of us max) Signs and graphics - anything from office signs, pavement signs to printed banners - these are all commercial and we go to the customer. For this its a new side to the business and Id say wed look to go withing 50 miles of our base. My dilemma is, firstly when pushing social media etc we have a real divide for who we target as we have the home owers and business owners on one hand and then car enthusiasts on the other. Also from an SEO point of view theres the local vs nationwide aspect. A few people I have spoken to have said trying to target local for some services and national for others may be a little problematic. I have some people saying have all services under one domain as the links back to the site and content will all help the site to rank better. This sounds logical to me. But then Ive had other people saying split the site into 2/3 sites. Definitely split the automotive which is local from the other national areas as these are also going to be a different audience 9car enthusiasts vs home/business owners). It will mean doing two lots of SEO but the sites will be more focused on the target audience and we can have one tagret local search and the other national. This too seems very logical. My gut feeling is that both options are sort of right but doesn anyone have any advice that could help me figure this out. Also to make things a little more complicated we have an ecommerce side were we supply goods direct to the public. Woudl I be better to have a fresh domain which is simply an ecommerce platform or have a seperate shop section on my main domain were people can go to buy the products if they dont want us to fit them?
Local SEO | | paulfoz16091 -
Correct setup: One business, one website, two bricks and mortar locations
Hi all, we have a furniture business with two physical stores and one website, which has the ability to sell online but we hardly sell anything but we're just about to start Google PLA on a few products, let's say our website is at: nicefurniture.co.uk We have nicefurniture.co.uk/first-location and nicefurniture.co.uk/second-location set up with all the store info, a Google Map, contact info, etc. This is linked to from the footer on all pages. Issue 1: I have been told conflicting things about how to best set up our Google My Business page. One person says set the URL for both to our homepage, nicefurniture.co.uk and the other says point each GMB listing to the store location pages OR we should buy www.furniture-first-location.co.uk as our URL and point the GMB listing to that. To me, that doesn't make sense as we'd be spreading our domain equity with a new domain, surely? Issue 2: How do I get each GMB location to show up in Maps, etc when people search for 'furniture location' or even 'sofa location' or 'dining table location'? Would I need to optimize the store pages on our site? Issue 3: Years ago we did set up another URL, let's say nicefurniture-cornwall.co.uk and on it there are about 500 pages, all with links pointing to our main website. Google Search Console for our main website lists this other website as one of our top linking domains. Does that mean if we remove nicefurniture-cornwall.co.uk we'll risk a drop in rankings? Many thanks for your input.
Local SEO | | Bee1590 -
Duplicate content across a number of websites.
We have a client who has approximately 25 retail sites (mini department stores) selling in general the same merchandise ranges - some stores carry all the ranges (brands) while others have fewer due to space restrictions. Each destination is different has its own branding and unique selling point which needs to be reflected. The client wants us to build individual websites for each location as they want to promote each location individually. I know that the search engines don't penalise duplicate content, but the core of each website is going to be essentially the same. My concern is there is no way you could write 25 different pages about the same Colony Candle range! Any ideas suggestions would be much appreciated - a one site option would not work as the client wants individual website and due to the different branding, USP and the fact they want to market them individually I would agree with them. Thanks Fraser
Local SEO | | fraserhannah0 -
2 websites or one .ca and .com
Hi I have a client with a lighting business in Canada but ship to all US- they have ecommerce web site .ca and .com the .ca has always brought more traffic. (they have a store in Canada) they are now redoing the site and trying to decide should they have just one site and the other redirected to it or should they have two and which one the main one- they would like to sell to the us but are obviously stronger in Canada- don't want to lose on both sides.. Appreciate any help!
Local SEO | | maryk920 -
Content Across International Websites
I am wondering if anyone could clear up some questions I have regarding international SEO and how to treat the content placed on there. I have recently launched several websites for a product internationally, each with the correct country domain name etc and I have also followed the guidelines provided by webmaster tools on internationalisation. All the websites are targeted towards English speaking countries and I have rewritten most of the of the content on there to suite the English style of the targeted country. This is being said however I am finding mixed bags of information on what to do in treating large chunks of potential duplicate content. For example my main .com website which has been running several years (and is targeted to the UK) has a lot of well written articles on there which are popular with the visitors. I am needing to find out if duplicating these articles onto the international versions of the websites, without rewriting them, would have a detrimental effect on SEO between all the sites. I have done a site search for each domain name to see if they are cropping up in other local Google versions (e.g .ca site in Google.com.au etc) and they are not. Does this mean Google is localised to its results regarding duplicate content or is it treated at the root level? Any information to point me in the right direction would be a big help.
Local SEO | | Rj-Media0