MOZ Crawl help
-
Our MOZ report says it crawled 1800 pages so it reports a lot of errors based on those pages. We don't have that many pages on our site. What is MOZ crawling? I updated the profile to make sure it crawls the filtered page section of Google Analytics.
-
Hey Jessica,
I took a look at your crawl diagnostics and there isn't anything that looks too out of the ordinary. You have 415 duplicate pages, which is over inflating your page count.
Additionally, when I exported your crawl diagnostics CSV I saw a mixture of static URLs and Dynamic URLs. This may mean that you have two coppies of each page being crawled, which could be leading to over inflated page totals. You might want to look at your CMS and make sure that it is not making 2 copies of each page.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Jessica,
Well that's a pretty good mix
Having a bunch of different kinds of errors like that could be due to a combination of issues, but I would think that first of all you have a duplicate content issue either because your cms is creating it through different urls for things like multiple categories, archive pages and that kind of thing or because you have a server setup issue that is allowing access to the same pages through multiple urls (like www vs non www urls). It might well be a combination of these things accounting for different errors so you are going to need to narrow down the data to find out exactly what is going on.
Download your error report in csv, open it in excel and select all and then do ctrl-windows-L combination. This will put your data into a filterable table. You can then go to the headers and filter (for example) only 404 pages or only duplicate title pages. Once you have filtered for a specific error have a look at the left hand column for which page or pages the problem is appearing on and then the far right hand column to see which page is linking to this page or pages. You will then have a better idea where the problem is and how it is being reached by the crawler and that will guide you on where to look to fix it. If you want to give a couple of example urls a few obvious things might stand out.
Hope that helps!
-
By filtered, I meant that we have a profile that filters out employees hitting the site. Sorry, shouldn't have mentioned it because it isn't relevant.
-
Hi Lynn,
Thank you for getting back to me. Here is an image of our diagnostics with the errors.
-
Hi Jessica,
What are the errors telling you? If it is a lot of duplicate content type errors it could be an indication that your site is linking to the same pages in multiple ways. So even though you think your site has xx number of pages, to the crawler (and search engines) it actually has more! Not sure what you mean in regards updating the profile to crawl filtered section of google analytics? If you care to give us an example of the errors and your site we might be able to give more details.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why doesn't Moz read the right meta description?
We have a WordPress blog and Moz continues to read our site title as the meta description instead of the nicely crafted and SEO-friendly meta descriptions we are writing on each post in our Yoast plugin. Can someone help use understand why Moz is reading the site title rather than the post meta descriptions? (We did test deleting the site title all together but then this made Moz think that there is no meta description for any of the posts.)
Product Support | | simran-s1 -
We at QMetry have purchased the license for Moz and I want to know till when will this subscription last and out of the 3 members who is the admin?
I want to know when the subscription will end for QMetry and we are a team of 3 using Moz, out of 3 of us who is the admin?
Product Support | | vatsala0 -
Link to Moz Pro home 404s, and then I stumbled upon Moz's staging site...
I'm wary of giving more information as it's probably best that little to no one be able to access Moz staging for one reason or another. I should also mention that this was done very unintentionally on my part. That said, from the 404 from Moz Pro home, I tried to access "My QA", and that's when I realized that everything I did thereafter was within staging.moz.com (and posted a question similar to this one). Does Moz permit access to their staging site, or did I stumble upon a mistake - or Moz-stake, if you will?
Product Support | | Lumina0 -
My Whole Moz Account Went Missing - Started From Scratch But Not Working Again
Hi guys my whole moz account went awol - lost all my previous campaign data in terms of search listings - got a bit fed up so started from scratch, the first week was ok but now I login to see where I am on the search engines and all I get is '-' can anyone help - I am paying top dollar for this service but it seems so unstable, I thought I was using this to save me time keying in hundreds of search phrases and manually checking them and as I am sure many of you will appreciate checking daily can drive you crackers so I signed up with the belief that once a week I would get an in depth report and as such I could take a sigh of relief and get away from the obsessive compulsion to check my listings daily - this does not seem to be the case - pretty frustrated to be honest. kind regards Gareth
Product Support | | GarethParkin0 -
Can we get direct live chat or contact information? Response in the community is not helping and making the process really slow
Its been almost half of the month and our account status is still showing not upgraded. Again and again trying to contact moz via forum and waiting for the response is hampering our work. Kindly let us know how to contact via live chat?
Product Support | | ShaunPhilips0 -
Duplicate Content Report: Duplicate URLs being crawled with "++" at the end
Hi, In our Moz report over the past few weeks I've noticed some duplicate URLs appearing like the following: Original (valid) URL: http://www.paperstone.co.uk/cat_553-616_Office-Pins-Clips-and-Bands.aspx?filter_colour=Green Duplicate URL: http://www.paperstone.co.uk/cat_553-616_Office-Pins-Clips-and-Bands.aspx?filter_colour=Green**++** These aren't appearing in Webmaster Tools, or in a Screaming Frog crawl of our site so I'm wondering if this is a bug with the Moz crawler? I realise that it could be resolved using a canonical reference, or performing a 301 from the duplicate to the canonical URL but I'd like to find out what's causing it and whether anyone else was experiencing the same problem. Thanks, George
Product Support | | webmethod0 -
Archived campaigns not in Moz Analytics
Hi team! Working in the awesome new Moz Analytics, I happened to notice that all (but one) of our archived campaigns seem to be missing from Moz Analytics (in the "Manage Your Campaigns" area). Have we jumped the gun and perhaps they're still working their way over in the migration? If so, do they have an estimated arrival date? Any light which can be shed on this is much appreciated. Thanks team!
Product Support | | wh-seo0 -
Maybe a silly question but do Moz write guest blogs? If so, who do I ask?
We have refreshed our website and, to supplement the content we write ourselves, we just want some nice, simple, quality written content from our suppliers, of which Moz is one. I'm probably being stupid, but I can't (yet) see how to contact anyone at Moz directly. While my search continues, I'll post this question.
Product Support | | TheInternetWorks0