How to detect where Google gets indexed URL's
-
Google index some kind of way some links that create duplicate content. We doesn't understand how these are created so we would like detect where Google robots find these links.
We tried:
- Moz Crawl Diagnostics but it shows 0 as Internal Link Count for these kind of links.
- Find some information from Google Analytics, that maybe there is trace (site content - all content) from visitors side. There wan't.
- We tried to find some information in Webmaster Tools under Internal link and HTML Improvements but didn't find any trace.
- Tried some search commands. Is there maybe some good one to search.
- TO search URL's form code with https://search.nerdydata.com.
-
It really isn't possible for an outsider to know why your website is generating those URLs in error; you would have to talk to your developer about that.
As far as canonicals, if your problem is page.com is getting duplicated by added parameters: page.com/?id=1, page.com/?id=2, page.com/?id=3, etc. as long as you have the canonical on page.com, all of the parameter pages will have the correct canonical on them as well. (But you are right, you should track down the source; your developer will know.)
-
Thanks you for your answer but yes I know that these are generated by our site. But problem is that I can use canonical tag for these that are indexed right now but later new ones will be created someway. Problem root isn't that we doesn't know how to use canonical, it's how to get to know where these URL's are find/indexed/detected by Google.
These kind of URL's have been there for months so we can't just hope that somehow these will be droped. We need to find some kind of solution and detect real problem.
-
If you found those URLs by doing a site: search, then those parameters are being generated by your site. (I am surprised that Google is even indexing them; I assume that pretty soon all but one will be dropped.) Here is an article that explains more about those types of duplicate pages: http://moz.com/blog/which-page-is-canonical
You can fix this by using a canonical tag on your homepage with the version that doesn't have the parameter.
-
Our front page has almost 50 duplicate versions. These are shown when we do site:oursite.com, there are /et?id=xx, /et?productId=xx, etc. In URL xx are different numbers.
-
Where are you seeing these duplicate content links? Does Webmaster Tools say that they are duplicate content? Or does this show up in your Moz crawl? What do these URLs look like?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google is reporting a server error, but there's no server error.
Google is erroneously reporting a server error and I just can't figure out the source of the issue. My links work, and GoDaddy ensures me there is no server error. This issue arose when I moved from HTTP to HTTPS and CPanel hosting, but I've got no idea how to fix it. I thought maybe I have duplicate content, but it does not appear that way. Any suggestions? I'm at a loss. www.thedishmaster.com
Reporting & Analytics | | TheDishmaster0 -
Query on google analytic benchmarking report
Hi All, First I select My Industry Vertical - ABCD then I select Region - US ( all region) then size by daily session - 10000-99999 finally reports appears "Blank" but when I decrease daily session from 10000-99999 to 1000-4999 or less then report is perfect. So what does it mean? My Avg daily session is 70k to 80k. So how to analysis benchmarking in this case? Thanks!
Reporting & Analytics | | pragnesh96390 -
Why isn't my google analytics working on a subdomain?
I have a website with Google Analytics which works fine. I tried adding the code to a subdomain using http://www.verticalrail.com/kb/filter-in-google-analytics-to-track-subdomains/ as a guide. There is no data showing up though. Any ideas?
Reporting & Analytics | | EcommerceSite0 -
Google WebMasters Tool - Preferred Domain
I just added Google Analytics to my wordpress site with Google Analytics by YOAST. I then added Google WebMaster tools through via verify through google analytics account. I then tried to set a preferred domain. I chose the non www. version; however, google wanted me to verify ownership of both versions in order to set a preferred domain. I then added the www. version of my domain. I was able to set the non-www. version to my preferred domain. Now, there are two example.com's in my webmaster tools. I have 10 sites. I intend to replicate this process on all of my sites. Do I have to leave the non-preferred version of my sites in the google webmaster? Can I delete it after I have set my preferred version? If I delete the non-preferred version will it delete my setting on the preferred version because it is now no longer verified (saved)?
Reporting & Analytics | | JML11791 -
"It appears there's a problem with our connection to your Google Analytics ...
account. Please go to your Settings page to update your connection." I set up a GA account for our website (www.edao.biz) prior to creating the SEO campaign. When I set up the campaign it told me there was a problem. I tried to fix the connection using the Settings page and it created a second account - however, it still cannot connect to it. In the GA account, it shows that I have granted access to pro.seomoz.org. I did not setup a 2-step verification with GA; don't think that's the issue. Should I blow both GA accounts away and try again? I don't think it's working correctly, and I would really like to be able to see the analytics for our site. I did see that in the GA account I had checked [v] Share my Google Analytics data... [v ] with other Google products only. - What should be the proper setting? (BTW I'm a bit lost with the new GA, I still go to the old interface (though ugly, it shows more links and info)) Thank you, Ingrid
Reporting & Analytics | | IngridWood0 -
Impressions in Google Analytics
I am trying to compare SERP impressions in Google Analtyics between two different time periods. I want to compare the last two months, with the previous two months. Now this works fine when I go to Traffic Sources > SEO > Queries. Our analytics has been set up since early last year, so I cannot understand why, for a couple of weeks at the start of the previous two months, it is showing that I have less than 10 impressions per day, then in one day, it jumps to 22,000 impressions, and starts to show 'real' information after that... Very frustrating when I am trying to show how effective my work has been. Can anyone shed any light on this?
Reporting & Analytics | | MirandaP0 -
Tagging URLs Linkbuilding and anchor links
Hi, I am going to publish a press release on a number of different websites. First and foremost, I want to build anchor links back to website for specific keywords. Secondly I want to measure clickthrus from each site using parameter tracking in GA. I want to know if I put in a url with ?utm_source=xxx, will this have any impact upon my linkbuilding efforts? i.e. will search engines attribute the keyword to the long url with tracking or the url without tracking. I understand that everything from the ? mark is ignored. However, i just want to double check before I publish release. Thanks for your help. Mik
Reporting & Analytics | | increation0 -
What's the best way to track moble traffic / sales from a subdomain in Google Analytics?
Hello, I've been trying to figure out the best way to track traffic and sales for a subdomain mobile site and would appreciate any feedback or guidance. I've set up an advanced segment but have found that I'm not able to source traffic since the segments get disabled when trying to view top content pages. I've also setup an additional sub-profile under the main domain profile in google analytics and have set up an advanced filter using the following guildelines http://code.google.com/apis/analytics/docs/tracking/gaTrackingSite.html In the Profile Settings page, click the Add Filter link. Choose Add New Filter and provide the filter a name. Choose Custom Filter and select Advanced on the Filter type settings. Under Advanced settings: FieldA should be set to Hostname FieldB should be set to Request URI Set the values for both Field A and Field B to (.*), which is an expression that captures all characters. Set the Output To --> Constructor option to Request URI and provide $A1$B1 as the value for that choice. I'm unsure if I've set up the profile / filter correctly, the traffic stats are different than the segment. The mobile profile is also tracking all ecommerce transactions instead of just mobile. Here's the code I have in place. we're using the Traditional code Thanks, Jamie
Reporting & Analytics | | marketing_zoovy.com0