WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at help@moz.com with the Campaign you're working.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
Java scripts creating 404
I have noticed that Moz crawler is unable to understand javascript links like this: https://www.olympus-ims.com/en/solutions/#!chooser[industries]=Mining-Geology Is there a workaround for my reports?
Link Explorer | | eoin-ossa0 -
Open Site Explorer Showing Blank Screen
Hi Moz Community, When I go to search for backlinks for any site, I am getting a blank screen after starting the search. This is happening to every search I perform for any URL or root domain. It's been happening for about a week now and I am not able to find any solutions. Any help would be greatly appreciated. Thanks! Ryan
Link Explorer | | RyanRhodesGW0 -
[No Title] in Top Pages using Open Site Explorer
Hello!
Link Explorer | | eagleleather
All of my pages contain properly formatted title tags which display in the browser. However, when I view the 'Top Pages' area of the Open Site Explorer, 99% of those pages show [No Title] in the Page Title & URL column. Does anyone know what might be causing this?0 -
Why does Open site explorer only show a fraction of the linked Domains that Google does?
One of my sites ( http://www.georgerossphotography.com ) shows 19 root domains and 155 links on Open Site Explorer. This doesn't pass the sniff test with me and when I look at Google Webmasters they show 120 domains with 1,870 links. I am assuming that Google use it's own data for ranking purposes which makes me question the validity of Open Site Explorer? Am I missing something ? I have been using OSE as my primary tool and now I feel that it has little value. I would appreciate any feedback. George.
Link Explorer | | sirgeorge0 -
Why does the number of the total external links and the followed linking root domains between Open site explorer and the campaign in Moz pro doesn't match?
Opensiteexplorer returns 52.473 total external links and 715 followed linking root domains while my campaign in Moz analytics return 35.899 total external links and 1092 followed linking root domains. Does anyone knows how this is possible?
Link Explorer | | ConversionMobstars0 -
Sites internal links are not showing as inbound links
My sites internal links are not showing as inbound links while my competitor site’s internal links are showing as their inbound links (In OSE). Is my site’s inter-linking weak? Or there could be other reasons.
Link Explorer | | vivekrathore0 -
Open Site Explorer not reporting all 301 redirected links
Our site had over 2,000 root domains linking to it as reported in MOZ Open Site Explorer (and Google Webmaster Tools). We then changed the domain and made sure that 301 redirects were set up for all pages across the site. That was about 1 month ago. Open Site Explorer is now reporting less than 300 linking root domains. For the links that it is reporting the majority of these are being 301 redirected to the new URLs (some of them we changed the links directly). However the majority of the links that are being 301 redirected are not being reported. It is reporting most of the links coming from the old to the new domain. Google Webmaster Tools is reporting over 1,000 linking root domains to the new domain (it has a max of 1,000). We did notice that MOZ took some time to update the domain authority of the new domain. It was 1 for along time and it has now jumped up to 46 ( it was previously at 74). Maybe this is a time delay thing and eventually Open Site Explorer will report all of the 301 redirected links? It is a bit frustrating at the moment as we can't fully analyse the links to the site to try to focus on the high domain linking sites to get them to change the link directly. Also, If all links are being 301 redirected to the new domain should the authority not be close to where it was previously after one month? Our search traffic has dropped considerably since the launch of the new site and hasn't returned yet, so just wondering if the 301 redirected links pass on as much value as thre original direct links. Thanks, Damien
Link Explorer | | james.harris0