How to set the crawler or reports to ignore
-
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off
I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
-
Thanks for the confirmation. I hadn't wanted to put that in the robots file because if inquisitive, non-robot traffic if you get my meaning, but in it goes; can't stand seeing errors.
-
Got it, thanks for jumping in so quick.
-
Hey Str8,
Donford is correct. You would need to specifically block our crawler from the mobile pages in your robots.txt file. Unfortunately, we don't currently have a way to disregard specific pages or errors in the web app, but we are looking to add that function sometime in the future.
I hope this helps. Please let me know if you have any other questions.
-
Hi Str8
**user-agent: rogerbot disallow: /*mobile=**
I think may do the trick... somebody may need to confirm this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Reporting a brand page as KW stuffed for the the brand KW, not a problem i presume ?
Hi if I'm getting a keyword stuffing warning on Moz for a brand page for the brand name kw that shouldn't really matter should it? Moz just oversimplifying it since seen the brand name says 27 times on a page think it's stuffed, but if its a 2000 word page all about the brand, those occurrences are totally natural & hence Google will think so too generally speaking? Thanks Dan
Moz Pro | | Dan-Lawrence0 -
Rankings Report - figures clarifiction
I've noticed a possible discrepancy with my data and the figures in the Ranking Report >> Rankings which leads to this question: In top 3 : 10 On first page: 19 Is this meant to mean 10 of the 19 are in the top 3, or after the 10 top 3 there are 19 more keywords on first page?
Moz Pro | | MickEdwards0 -
Chage email alert settings
I'd like to change my email alert settings for my campaigns. I want them to go to seomoz@cabedge.com, not paulh@cabedge.com. How do I change that? thanks Paul
Moz Pro | | Atiba0 -
Can I setup SEOmoz PRO's 3 organic traffic metrics within Google Analytics (as custom reports)?
I like the 3 organic traffic metrics in SEOmoz PRO: 1) Organic Search Visits
Moz Pro | | AndreVanKets
2) URLs Receiving Entrances Via Search
3) Non-Paid Keywords Sending Search Visits They rock - especially for a high-level view of SEO / Organic performance. Is it possible to setup these metrics as custom reports directly in Analytics? Does anyone have these reports setup? Or maybe there are similar custom reports that give a similar high-level view?0 -
Are organic site links excluded in the rankings report?
If I'm pulling a rankings report for a specific subdomain and a different subdomain appears at the main result and the specific subdomain is a site link beneath it, does that show up in the results? It doesn't seem to in my report.
Moz Pro | | mattiasantin0 -
How do I find the corresponding duplicate content pages from my SEOmoz report?
Once I have run my report and the duplicate content pages come up, is there a way to find out which pages have the duplicate content on them? I have one URL but where can I find the duplicate content that corresponds to it? Thanks Barry
Moz Pro | | MrBarrytg0 -
Best Keyword Ranking Report Tool
What's the best keyword ranking report tool that anyone is using currently? I have used CuteRank (booo), Rank Tracker, SEOBook.com Rank Tracker, etc. Cost isn't an issue - I'm looking for a free or a paid tool. I need to be able to export resutls in PDF and Excel format. Thanks for the feedback!
Moz Pro | | ezclickmedia0 -
On Page Optimization Reports - Huh?
I've been working hard to use this EXCELLENT tool for optimize some of what I consider my most important pages . . . But the automatic tool that pulls pages and grades them (the "summary" of the "on page" report) . . . I don't get it. It only graded three of my pages, and I don't understand how it chose what keywords to grade it for? I'm just very confused. I don't understand how it chose the pages to grade, not the words it chose to grade it against. 😞
Moz Pro | | damon12120