Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Other domains hosted on same server showing up in SERP for 1st site's keywords
-
For the website in question, the first domain alphabetically on the shared hosting space, strange search results are appearing on the SERP for keywords associated with the site.
Here is an example:
A search for "unique company name" shows the results: www.uniquecompanyname.com as the top result.
But on pages 2 and 3, we are getting results for the same content but for domains hosted on the same server. Here are some examples with the domain name replaced:
UNIQUE DOMAIN NAME PAGE TITLE
ftp.DOMAIN2.com/?action=news&id=63
META DESCRIPTION TEXTUNIQUE DOMAIN NAME PAGE TITLE 2
www.DOMAIN3.com/?action=news&id=120
META DESCRIPTION TEXT2UNIQUE DOMAIN NAME PAGE TITLE 2
www.DOMAIN4.com/?action=news&id=120
META DESCRIPTION TEXT2UNIQUE DOMAIN NAME PAGE TITLE 3
mail.DOMAIN5.com/?action=category&id=17
META DESCRIPTION TEXT3ns5.DOMAIN6.com/?action=article&id=27
There are more but those are just some examples.
These other domain names being listed are other customer domains on the same VPS shared server. When clicking the result the browser URL still shows the other customer domain name B but the content is usually the 404 page. The page title and meta description on that page is not displayed the same as on the SERP.As far as we can tell, this is the only domain this is occurring for.So far, no crawl errors detected in Webmaster Tools and moz crawl not completed yet.
-
For those that are interested, we figured out the root of the problem and the fix. Maybe this will help someone down the road. Thanks to all that responded.
As it seems all the domains/accounts hosted on our VPS are top level; so we couldn’t use robots.txt to fix this.The problem:
-We have a handful of websites using a shared IP address – Only sites with SSL cert get a dedicated IP
-Some of these websites have additional A record DNS names (mail.domain1, ns5.domain2, etc) that all resolve to that shared IP address
-Within your browser if you went to one of those records it would pull up the website (account) that is first alphabetically within that shared IP pool
-It’s assumed that a website or multiple websites somewhere in the web must have linked these domain names somewhere on their webpages – so search engines crawled them for the content of that first alphabetical website
-Search engines then indexed the content of that site for these other DNS A records and displayed the alternate URLs in the SERPSThe fix:
Edit Apache’s httpd.conf file on our VPS – adding a new (first listed) virtual directory of that shared IP address to point to the servers cpanel default cgi page instead of listing one of our hosted accounts first.
This page describes what we needed done and what fixed it for us: http://forums.spry.com/cpanel-whm/1568-how-can-i-change-default-page-ip-address-points.html
Thanks again!
-
You should be able to resolve this with robots.txt and .htaccess files, but one more thing I've learned to do is to use a domain name for the primary domain that I do not plan to submit to Google for indexing. For example, I'll use arbitrary color names like silverblue.net as the primary domain and then the domains I intend to index will be virtual domains. This isn't really necessary but it helps me keep all my domain names straight in my head and avoid the issue you described above.
Best,
Christopher -
Thanks for the replies, guys. We are going to try Christopher's suggestion first and we'll update the question when it's resolved!
-
The other domains are ours, yes.
Oh, that's a horse of a different color. If you have multiple domains on one account, one domain will be the primary domain and the other domains will be virtual domains. If you look at the file structure on your server, all the virtual domains will be sub-folders under the primary domain. You need to create a robots.txt file in the primary domain that blocks the spiders from discovering the other domains through the sub-directory structure. Otherwise, all the virtual domains will be duplicated, once via the primary domain and again via the virtual domain.
Best,
Christopher -
The other domains are ours, yes.
I don't think any of them are using Joomla.
-
Are those other domains also yours, by any chance and/or is this a Joomla cms?
-
Wow... that's not so ideal. My guess is that all of those sites are sharing the same IP address, and the server's settings are such that if you hit the IP address with a forward slash (i.e. http://00.00.00.00/domainname/) it's showing content.
My $0.02 is to find a new hosting company.... and one that gives each site it's own IP address instead of doing shared-level hosting with the same IP address in a name-based space.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
After hack and remediation, thousands of URL's still appearing as 'Valid' in google search console. How to remedy?
I'm working on a site that was hacked in March 2019 and in the process, nearly 900,000 spam links were generated and indexed. After remediation of the hack in April 2019, the spammy URLs began dropping out of the index until last week, when Search Console showed around 8,000 as "Indexed, not submitted in sitemap" but listed as "Valid" in the coverage report and many of them are still hack-related URLs that are listed as being indexed in March 2019, despite the fact that clicking on them leads to a 404. As of this Saturday, the number jumped up to 18,000, but I have no way of finding out using the search console reports why the jump happened or what are the new URLs that were added, the only sort mechanism is last crawled and they don't show up there. How long can I expect it to take for these remaining urls to also be removed from the index? Is there any way to expedite the process? I've submitted a 'new' sitemap several times, which (so far) has not helped. Is there any way to see inside the new GSC view why/how the number of valid URLs in the indexed doubled over one weekend?
Intermediate & Advanced SEO | Aug 12, 2019, 8:56 AM | rickyporco0 -
Combining Two Sites With Similar Domain Authority
Hello, We run two sites with the same product, product descriptions and url structure. Essentially, the two sites are the same except for domain name and minor differences on the home pages. We've run this way for quite a few years. Both sites have a domain authority of 48 and there are not a large number of duplicate incoming links. I understand the "book" to say we should combine the sites with 301's to the similar pages. I am concerned about doing this because "site 2" still does about 20% of our business. We have been losing organic traffic for a number of years. I think this mainly has to do with a more competitive environment. However, where google used to serve both our sites for a search term it now will only show one. How much organic benefit should we see if we combine. Will it be significant enough to merge the two sites. Understandably, I realize the future can't be predicted but I would like to know if anyone has had a similar experience or opinion Thanks
Intermediate & Advanced SEO | Jan 31, 2019, 4:18 PM | ffctas0 -
Change Google's version of Canonical link
Hi My website has millions of URLs and some of the URLs have duplicate versions. We did not set canonical all these years. Now we wanted to implement it and fix all the technical SEO issues. I wanted to consolidate and redirect all the variations of a URL to the highest pageview version and use that as the canonical because all of these variations have the same content. While doing this, I found in Google search console that Google has already selected another variation of URL as canonical and not the highest pageview version. My questions: I have millions of URLs for which I have to do 301 and set canonical. How can I find all the canonical URLs that Google has autoselected? Search Console has a daily quota of 100 or something. Is it possible to override Google's version of Canonical? Meaning, if I set a variation as Canonical and it is different than what Google has already selected, will it change overtime in Search Console? Should I just do a 301 to highest pageview variation of the URL and not set canonicals at all? This way the canonical that Google auto selected might get redirected to the highest pageview variation of the URL. Any advice or help would be greatly appreciated.
Intermediate & Advanced SEO | Jul 30, 2018, 3:28 PM | SDCMarketing0 -
One of my Friend's website Domain Authority is Reducing? What could be the reason?
Hello Guys, One of my friend's website domain authority is decreasing since they have moved their domain from HTTP to https.
Intermediate & Advanced SEO | Aug 7, 2016, 6:33 PM | Max_
There is another problem that his blog is on subfolder with HTTP.
So, can you guys please tell me how to fix this issue and also it's losing some of the rankings like 2-5 positions down. Here is website URL: myfitfuel.in/
here is the blog URL: myfitfuel.in/mffblog/0 -
My site shows 503 error to Google bot, but can see the site fine. Not indexing in Google. Help
Hi, This site is not indexed on Google at all. http://www.thethreehorseshoespub.co.uk Looking into it, it seems to be giving a 503 error to the google bot. I can see the site I have checked source code Checked robots Did have a sitemap param. but removed it for testing GWMT is showing 'unreachable' if I submit a site map or fetch Any ideas on how to remove this error? Many thanks in advance
Intermediate & Advanced SEO | Nov 23, 2015, 1:10 PM | SolveWebMedia0 -
ScreamingFrog won't crawl my site.
Hey guys, My site is Netspiren.dk and when I use a tool like Screaming Frog or Integrity, it only crawls my homepage and menu's - not product-pages. Examples
Intermediate & Advanced SEO | Jul 13, 2015, 2:23 PM | FrederikTrovatten22
A menu: http://www.netspiren.dk/pl/Helse-Kosttilskud-Blandingsolie_57699.aspx
A product: http://www.netspiren.dk/pi/All-Omega-3-6-9-180-kapsler_1412956_57699.aspx Is it because the products are being loaded in Javascript?
What's your recommendation? All best,
Fred.0 -
Should I 'nofollow' links between my own sites?
We have five sites which are largely unrelated but for cross-promotional purpose our company wishes to cross link between all our sites, possibly in the footer. I have warned about potential consequences of cross-linking in this way and certainly don't want our sites to be viewed as some sort of 'link ring' if they all link to one another. Just wondering if linking between sites you own really is that much of an issue and whether we should 'nofollow' the links in order to prevent being slapped with any sort of penalty for cross-linking.
Intermediate & Advanced SEO | Jan 28, 2013, 2:40 PM | simon_realbuzz0 -
IP address guideline for 2 sites on same server linking each other.
Hi Guys! I have two websites which link to each other but are on the same server. Both the sites have a great PR and link juice. I want to know what steps shall I take in order to make google feel that both the sites are not owned by me. Like shall i get different IP and different servers for both or something more? Looking forward for you thoughts and help!
Intermediate & Advanced SEO | Dec 24, 2012, 4:23 AM | HiteshBharucha0