I'm doing a crawl analysis for a website and finding all these duplicate URLs with "null" being added to them and have no clue what could be causing this.
-
Does anyone know what could be causing this? Our dev team thinks it's caused by mobile pages they created a while ago but it is adding 1000's of additional URLs to the crawl report and being indexed by Google. They don't see it as a priority but I believe these could be very harmful to our site.
examples from URL string:
uruguay-argentina-chilenullnull/days
rainforests-volcanoes-wildlifenullnull/reviews
of-eastern-europenullnullnullnull/hotels -
Hi there,
This looks to be something to do with a URL generator that is dynamically creating URLs based on certain categories being present.
The downside being that those categories look to have been removed, hence the 'null' values being passed through.
I would push this back to your developers as a serious issue, there could be a large amount of duplication occurring if you're not careful.
All the best,
Sean
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Content Issue: Mobile vs. Desktop View
Setting aside my personal issue with Google's favoritism for Responsive websites, which I believe doesn't always provide the best user experience, I have a question regarding duplicate content... I created a section of a Wordpress web page (using Visual Composer) that shows differently on mobile than it does on desktop view. This section has the same content for both views, but is formatted differently to give a better user experience on mobile devices. I did this by creating two different text elements, formatted differently, but containing the same content. The problem is that both sections appear in the source code of the page. According to Google, does that mean I have duplicate content on this page?
Web Design | | Dino640 -
SEO Consulting for HUGE Website. How Big Is TOO Big Of A Change?
SEO Consulting for a HUGE Website. Their h1 tags have instagram/twitter, h2 have their menu/what's trending and h3 is the article title. Here's what I want to do... MY MAIN QUESTION: This site has tens of thousands of pages, all articles beyond the few dozen category/tag pages they have. If I change the structure to the following, will it be too much of a system shock to Google? Will this actually HURT them? Currently on the site: - h1 tags point to Twitter/Instagram sidebar widgets
Web Design | | BrianGilmore
h2 tags point to the menu/what’s trending section (which is the same on every page)
h3 points to the Title of the Article I want to change it to this: - h1 tags should delineate the article's name. That's all they should really be used for.
h2-4 should be reserved for article subheadings to be used by the editorial staff. EDIT: 30% of their >11 million monthly uniques come from search. I don't want to eff with that, but the way that NONE of their pages have optimized words, they have no sitemap, webmaster tools and are still doing this well makes me think that even putting in minimal changes to tidy things up will help them bring it to 70% organic search.0 -
What structured data would you recommend marking up for a companies 'service'?
Hi, I'm finally starting to use structured data in my clients sites now that Google has embraced it so much. I have a client that is a cosmetic physician and has associated services. I thought it would be beneficial to markup each service according to http://schema.org/Service I'll be doing a similar thing with a new local surveyors website too. I'm just wondering if it is worth doing and what Schema properties would you recommend using. For the cosmetic physician I'm thinking of: description
Web Design | | morktron
name
url
sameAs
provider
serviceArea
serviceType0 -
Mobile website strategy
Hello all! This question is about mobile websites. Any suggestions are welcomed. The facts: We have recently built a mobile website for our business using the separate mobile urls (parallel mobile website on a m. sub-domain). We are in the service industry and while our customers are most of the time on the go, it is important for them to find the price and order the service as fast and easy as possible. The redirect from desktop to mobile happens when customers are accessing the website with a mobile devices and it's done automatically. The mobile version does not have any content and serves only as a search and order function. The SEO has been made for the desktop website only and we are ranking really well for all competitive keywords in our niche. We want to keep the mobile website simple and clean so we are not planning to add any content on it.The questions: Since we are not planning to have much content on the mobile website, do we need to do any SEO for it? If yes, why? What are the benefits? Should we add content on the mobile website and why? Is there any down-side from an SEO perspective due to the fact that the website redirects to the mobile version? How are the inbound links going to behave in this case? Do we need to link these two websites although there is no risk about duplicate content? (links, canonical tags, sitemaps) Will the mobile website take advantage of the link building made for the desktop version? Should we allow the mobile website to be indexed having the fact that this is just a search & book tool? (at the moment it is blocked via robots.txt) Thanks for reading, looking forward to your answers.
Web Design | | echo10 -
Website URL Structures - Which does Google prefer or does it matter?
Which URL structure does google prefer..............OR DOES IT REALLY MATTER? Option A www.example.com/services/service#1 - this is the default that wordpress uses Option B www.example.com/service#1
Web Design | | webestate0 -
Google fails to pick out the correct URL of the story
Hi , I have a page with many news storeys on it. Google craws the page but it picks up a more general url even though I've embedded the direct URL within anchor tags around the headline . The snippet below got linked by Google to http://www.irishnews.com/ Any idea how i can get Google to pick-up http://www.irishnews.com/news.aspx?storyId=1180708 would be very welcome Peter Quinn: Family made scapegoats of financial crisis News Peter Quinn: Family made scapegoats of financial crisis THE Quinn family have been made scapegoats of the financial crisis surrounding the former Anglo Irish Bank, tycoon Sean Quinn's brother Peter claimed yesterday.Peter Quinn, a former president of the GAA, said hi read more»
Web Design | | Liammcmullen0 -
Multiple Sites, multiple locations similar / duplicate content
I am working with a business that wants to rank in local searches around the country for the same service. So they have websites such as OURSITE-chicago.com and OURSITE-seattle.com -- All of these sites are selling the same services, but with small variations in each state due to different legal standards in the state. The current strategy is to put up similar "local" websites with all the same content. So the bottom line is that we have a few different sites with the same content. The business wants to go national and is planning a different website for each location. In my opinion the duplicate content is a real problem. Unfortunately the nature of the service makes it so that there aren't many ways to say the same thing on each site 50 times without duplicate content. Rewriting content for each state seems like a daunting task when you have 70+ pages per site. So, from an SEO standpoint we have considered: Using the canonocalization tag on all but the central site... I think this would hurt all of the websites SERPs because none will have unique content. Having a central site with directories OURSITE.com/chicago -- but this creates a problem because we need to link back to the relevant content in the main site and ALSO have the unique "Chicago" content easily accessable to Chicago users while having Seattle users able to access their Seattle data. The best way we thought to do this was using a frame with a universal menu and a unique state based menu... Also not a good option because of frames will also hurt SEO. Rewrite all the same content 50 times. You can see why none of these are desirable options. But I know that plenty of websites have "state maps" on their main site. Is there a way to accomplish this in a way that doesn't make our copywriter want to kill us?
Web Design | | SysAdmin190 -
Duplicate content and blog/twitter feeds
Hi Mozzers, I have a question... I'm planning to add a blog summary/twitter feed throughout my website (onto every main content page) and then started worrying about duplicate content. What is best practice here? Let me know - thanks, Luke PS. I sat down and re: blog feed... thought that perhaps it would help if I fed different blog posts through to different pages (which I could then edit so I could add<a></a> text different from that in blog). Not sure about twitter.
Web Design | | McTaggart1