Mobile site ranking in desktop searches
-
A robots.txt file is properly implemented on the mobile site to block Googlebot from crawling, yet, when running a site: query for the site in google, it still returns over 104,000 pages from the mobile site in the index.
Why could this be happening?
-
I have thse recomendations:
1. Specify your Doctype to help Google see what your content type is. For mobile Google supports XHTML Basic, XHTML Mobile Profile, XHTML, WML, cHTML (iMode), and EZweb (KDDI). We run HTML 5, CSS 3 and jQuery successfully but these are not specified by google, so i would recommend to be safe and go with what Google supports.
2. Add a specialized XML Sitemap for Mobile. It is basically the same as the usual Sitemap apart from adding these to elements: xmlns:mobile="http://www.google.com/schemas/sitemap-mobile/1.0 and mobile:mobileRead more here: http://www.google.com/support/webmasters/bin/answer.py?answer=34648</mobile:mobile>
P.S. Name it mobilesitemap.xml.
3. Use WURFL to redirect PC users finding mobi content in the www index back to the PC version.
That should help.
-
If you haven't asked a question in private Q&A yet this month, you can ask there and share your URL, as that is private and available to only SEOmoz staff and associates.
Have you gone into GWT and requested removal of the site? If you verify the site, and then have the site/directory blocked via robots.txt, you can use the removal tool to request removal rather than waiting for things to drop out of the index.
-
Thanks for responding Keri!
I can confirm that there are no parameters overriding the robots.txt within the code. I also can confirm that there is nothing amiss with the verification of the robots.txt.
Also, unfortunately, due to the nature of the client, we are unable to put the URL out there.
If you have any other thoughts, please do share. Sorry I couldn't be of more help.
Thank you.
-
How long has the robots.txt file been in place? If you added it just a few days ago, it takes time for things to get out of the index. Other thoughts are looking at the source code of the pages on the mobile site -- is there a robots parameter on the page that is overriding robots.txt?
Have you gone into GWT and used the robots verification tool there to make sure nothing was amiss?
If you can give us your URL, the community can take a look and see if they can figure anything out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirecting old html site to new wordpress site
Hi I'm currently updating an old (8 years old) html site to wordpress and about a month ago I redirected some url's to the new site (which is in a directory) like this... Redirect 301 /article1.htm http://mysite.net/wordpress/article1/
Technical SEO | | briandee
Redirect 301 /article2.htm http://mysite.net/wordpress/article2/
Redirect 301 /article3.htm http://mysite.net/wordpress/article3/ Google has indexed these new url's and they are showing in search results. I'm almost finished the new version of site and it is currently in a directory /wordpress I intend to move all the files from the directory to the root so new url when this is done will be http://mysite.net/article1/ etc My question is - what to I do about the redirects which are in place - do I delete them and replace with something like this? Redirect 301 /wordpress/article1/ http://mysite.net/article1/
Redirect 301 /wordpress/article2/ http://mysite.net/article2/
Redirect 301 /wordpress/article3/ http://mysite.net/article3/ Appreciate any help with this0 -
Sudden traffic down after mobile site
Hi to all. I have a huge problem about my web site traffic. We published our mobile site version under mobile domain in m.etilercerrental.com. And we published mobile site sitemap under main site such as sitemap-mobile.xml and notify google from webmaster tools. After a while whole site traffic gone down so badly. Almost 60% gone down which doesnt make sense. Mobile sitemap is hosted under desktop site. And we didnt add any link to switch sites between mobile and desktop version. We automaticly redirect between desktop and mobile versiyons by detecting useragent. One another this is we have announcement section in dekstop version but we dont have it in mobile. But we are not making any redirection to mobile site when user visits the announcement section even by mobile phone. Because we are not displaying it in mobile version.
Technical SEO | | gkhnrtk
One last this is we are making redirections automatically and not asking user preference such as showing a link in the bottom of page to switch sites betwenn mobile and pc version. While developing mobile site we followed instructions in this https://developers.google.com/webmasters/smartphone-sites/?hl=tr For find the details I would like to give you some site urls. Site Url : http://www.etilercarrental.com/
Sitemap Xml : http://www.etilercarrental.com/sitemap.xml
Mobile Sitemap Xml : http://www.etilercarrental.com/sitemap-mobile.xml0 -
Can you help with some concerns over mobile site in SERPS
Hi Guys I wonder if you can put me right on this query please? We have a mobile version of our site, on an m. domain. it is actually http://m.uniquemagazines.co.uk. I have created a mobile sitemap, and added the sitemap reference to the robots.txt file. I have setup the site in web master tools, and submitted the sitemap to web master tools. The sitemap can be found at http://m.uniquemagazines.co.uk/sitemap.xml. This is an index file, which in turn links to 3 sitemaps, one for pages, one for product pages and one for category pages. I have not blocked any crawlers in the robots.txt file. My query is we have some products showing up in the SERPS with both the mobile and normal website. Secondly, in web master tools I am told that our mobile sitemap contains 3675 submitted URLs. However, it states under the WEB banner that 3675 submitted, and 3675 indexed. But under MOBILE it states 3675 submitted, none indexed... I will attempt to attach a screenshot from WMT of this. Do you have any ideas what has gone wrong here? is it wrong, or is this what you would expect to see? Many thanks Paul ScreenHunter_18%20Feb.%2021%2010.55.jpg
Technical SEO | | TheUniqueSEO0 -
Why am I ranking for this
In need of some second opinions here. I have a domain softboxsystems.co.uk which ranks for the keyword sofrigam. It is not meant to! Have posted previously on this but to cut long story short, the clients .com started to rank for this term and then they lost the contract to supply the services so got a legal request to stop ranking for it (it had been seoed so was ranking 100% on off page issues). The client is a UK company so they decided that they would block the .com from google and use the co.uk domain for a period of time instead while they worked on deranking the domain. The .com domain was therefore blocked from the index, the .co.uk homepage would not rank for anything then it turned out that they had placed a canonical tag link from the .co.uk to the blocked .com!!! On my suggestion this was removed and the homepage of the .co.uk appeared in google in a matter of a couple of days (other pages on the site were indexed but not the home). Now, somehow the co.uk domain homepage is ranking for the banned term. I have checked open link and there are not any links pointing to the domain with the anchor of sofigram, nor is the term mentioned onsite. I now have the client panicking on the phone to get the page out of google again asap before the competitors legal people get wind of it. I am still trying to deindex the .co.uk homepage in the short term. I have readded the canonical back to the .com as that worked at not getting that page indexed previously. The main issue I have is how on earth I am ranking for this term in the first place and more importantly how do I stop from ranking for this term! The only terms I can find as anchor text in the moz tools are the keywords I have been seoing for help hehe thanks
Technical SEO | | Grumpy_Carl0 -
Redirecting a old aged site to a new exact match site?
Hi All, I have a question. I have 2 sites with me in the same sector and want some help. site 1 is a old site started back in 2003 and has some amount of links to it and has a pr 3 with some good links to it but doesn't rank much for any keywords for the timing. site 2 is a aged domain but newly developed with unique content and has a good amount of exact match with a .com version. so will there be any benefit by redirecting site 1 to site 2 to get the seo benefits and a start for link bulding? or is it best to develop and work on each site? the sector is health insurance. Thanks
Technical SEO | | macky71 -
Used SEOMOZ top 100 Directories, my site ranking lowered, what can we do to fix this?
We have made a big mistake.... So what can we do to fix this? A trainee member of staff has used the seomoz 100 top directories and added to sites from PR10 to PR6 approx about 25 sites, using keywords were possible instead of using the website URL "which i now was stupid!. Our website ranking have been lowered big time for all keywords used!, eg from 1st to 10th and even disappeared from the top 100 We are contacting all directories asking for the Title link to be changed to the URL instead of a keyword.. Will this help? I understand that Google give sites a penalty for this!!, but what can i do to put this right and how long would this penalty last for? Any advice would be highly appreciated... Thanks Dean
Technical SEO | | deanpallatt0 -
Recently revamped site structure - now not even ranking for brand name, but lots of content - what happened? (Yup, the site has been crawled a few times since) Any ideas? Did I make a classic mistake? Any advise appreciated :)
I've completely disappeared off Google - what happened? Even my brand name keyword does not bring up my website - I feel lost, confused and baffled on what my next steps should be. ANY advice would be welcome, since there's no going back to the way the site was set up.
Technical SEO | | JeanieWalker0