WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at [email protected] with the Campaign you're working.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My Site Facing indexing issues
Hello, I am facing indexing issues on one of my which is about budget bushcraft knife , Four months have been passed I built my site and published almost 7 article so far. But i am worried no any single keyword ranked on google till yet as i checked through MOZ site explorer. Can anyone guide me what should I need to do now. Thanks
Link Explorer | | james112230 -
Does the Moz Pro site crawl, crawl password protected sites?
So i asked Moz Pro site crawl to crawl my page, and a lot of issues came up - but for password protected sites. Does the Moz Pro site crawl do this? A lot of the issues, are not relevant for a site that is password protected.
Link Explorer | | Minlaering.dk0 -
Open Site Explorer -> Just Discovered -> Internal Links: Only shown 1 url link per day
Hi, We have a page that have like 10-15 new content/pages per day.
Link Explorer | | Inspiringinterns
eg. domain.com/post-id-01/, omain.com/post-id-02/, omain.com/post-id-03/ etc
But somehow, under Just-Discovered, internal links only show 1 per day when it suppose to display like 10-15.
The layout for each pages is exact same except for the content changes and the url's ID changes. Our competitor on the other hand, they have like 5 new page per day, but somehow Moz shows their internal links as 25 per days. Each of their new url have 4 more prefix number.
Eg:
new-page-01?track=990
new-page-01?track=991
new-page-01?track=992 etc
The above example url is technically as 1 page if without the "?" affix. Whiles all our new pages/url have unique id, but Moz only show 1 a day. Please advise on how to get Moz to shows all the new pages in Just-Discovered (internal link). Thanks, Cam0 -
I crawled my site, but an old crawl report still is visible
I crawled my site recently, but an old crawl report still is still all I can see
Link Explorer | | Bigjim0 -
Spam Score and crawling of my site
Hello, I'm trying to analyze the spam score of my site which is 9/17 Actually I have few backlinks and all of them have a low spam score (max 4/17, just one). I think there's some kind of issue with the crawler since I get strange spam factors: Large Site with Few Links (likely true, I recently deleted a lot of tags used once) Low Number of Pages Found (wasn't it a "Large Site"??) Low Number of Internal Links (I got a considerable number) No Contact Info (I have a link to my facebook in the menu and a "contacts" page) Thin Content (It's just a blog with min 300 words per post, why thin?) Site Link Diversity is Low (likely true) Ratio of Followed to Nofollowed Subdomains (likely true) Low MozTrust or MozRank Score (true) Ratio of Followed to Nofollowed Domains (likely true) Can you please help me to understand it, is it a crawling problem or similar? If needed I will post the url of the website. Thank you so much Marco
Link Explorer | | MarcoBP0 -
Open site explorer is giving me strange redirect message.
Hi all, I tried to find answer in help section. Few people have asked this before but in none of the answers it tells how they fix it. Sorry I will need to ask here again. In Open Site Explorer i get this message. You entered the URL https://a-fotografy.co.uk/ which redirects to http://www.a-fotografy.co.uk/. Because it's likely to have more accurate metrics, we're showing data for the redirected URL instead. Click here to analyze https://a-fotografy.co.uk/ instead? My current site is https://a-fotografy.co.uk/ not sure why it is redirecting to my old domain. Weird. My web developer couldn't explain this issue. Saying that I also go my first analytics report and in priority issues I have http://a-fotografy.co.uk 302 redirect and not sure where it is redirecting to. If someone could shed some light of how to figure out how to find exactly what is redirecting to what and where is the problem. Thank you guys, Regards, Armands
Link Explorer | | A_Fotografy0 -
Open site Explorer Facebook Shares
In open site explorer I have been trying to increase my Facebook Shares and likes. I recently posted my URL and got over 150 likes but none of that has been showing up in open site explorer. I noticed my profile was set to private so I went back and made sure it was public and the shared link was public but nothing. Can anybody explain to me what exactly the Facebook share is measuring? Because the explanation it gives me isn't working for some reason. Perhaps it takes a bit longer for Facebook measure than Twitter or Google Plus, but it has been a few days and I would expect it to have registered by now. Any help would be great. If it helps you can help check it out. My URL is http://www.baselinedental.com Thanks!
Link Explorer | | BDP19780 -
Open Site Explorer
Confused by the results displayed in Open Site Explorer. Want to know the Total Links into a site. As such typed in the site address and received the result 28 Total Links from 1 Root Domain. Filter Set to This Page. Therefore, changed the filter to **Pages on This Root Domain. **All other filters set to All (i.e. internal and external links). I would assume this should give me ALL LINKS coming into all pages. I received results of 79 Total Links from 28 root domains. Raven and other tools advise a Total number of links in excess of 2,000. External Backlinks 200+. I have experienced this problem on a number of sites over the past month, in what way am I interpreting the data incorrectly? Why is there such disparity? Please advise. Kind regards
Link Explorer | | Arkix0