What are the solutions for Crawl Diagnostics?
-
Hi Mozers,
I am pretty new to SEO and wanted to know what are the solutions for the various errors reported in the crawl diagnostics and if this question has been asked, please guide me in the right directions.
Following are queries specific to my site just need help with these 2 only:
1. Error 404: (About 60 errors) : These are for all the PA 1 links and are no longer in the server, what do i do with these?
2. Duplicate Page Content and Title ( About 5000) : Most of these are automatic URL;s that are generated when someone fills any info on our website. What do I do with these URL;s. they are for example: _www.abc.fr/signup.php?_id=001 and then www.abc.fr/signup.php?id=002 and so on. What do I need to do and how? Plzz.
Any help would be highly appreciated.
I have read a lot on the forums about duplicate content but dont know how to implement this in my case, please advise.
Thanks in advance.
CY
-
I am glad, I brought it to your notice.
One last question for you, I have put the canonical of all these PR 1 pages to my home page, is it fine?
-
Charu, I went through one of my campaigns and it looks like you're right on that.
-
Thanks, I did what you suggested.
However, after setting the canonical tag, I guess now Moz does not report this asduplicate content or missing/duplicate title, instead it shows this under notices as Rel=Canonical tag.
Please correct me if I am wrong.
-
404 errors will usually mean that there are active links to pages on your site that don't exist. You need to find those links using OSE or a tool like screamingfrog and then you need to remove or revise those links.
Duplicate content--add a rel=canonical tag to the header of the www.abc.fr/signup.php page that shows that it is the canonical version. The duplicate versions will then carry the same tag, indicating that the original is the canonical version of the content. While that's a good practice for the search engines, it won't stop those pages from showing up in Moz's reports as duplicates--they will continue to show up as dupes if they get crawled.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
When I crawl my site On Moz it says it can't access the robots.txt file, but crawl is fine on SEM Rush - Anyone know any reason for this?
Hi guys, When I try to run a site crawl on Moz it returns an error saying that it has failed due to an error with the robots.txt file. However, my site can be crawled by SEM Rush with no mention of problems with roots.txt file issues. My developer has looked into it and insists their is no problem with my robots.txt and I've tried the Moz crawl at least 6 times over an 8 week period. Has anyone ever seen such a large discrepancy between Moz and SEM Rush or have any ideas why Moz has this issue with my site?? TIA everyone
Getting Started | | Webreviewadmin0 -
Standard Syntax in robots.txt doesn't prevent Moz bot from crawling
A client is getting many false positive site crawl errors for things like duplicate titles and duplicate content on pages that include /tag/ in the URL. An example is https://needquest.com/place_tag/autism-spectrum-disorder/page/4/ To resolve this we have set up a disallow statement in the robots.txt file that says
Getting Started | | btreloar
Disallow: /page/ For some reason this appears not to work, as the site crawl errors continue to list pages like this. Does anyone understand why that would be and what we need to do to properly disallow crawling these pages?0 -
Page Count per campaign - Crawl Usage 500,000 Pages
How to you find the page crawl count per campaign? I have 3 campaigns and Moz stats I have used 150,000 pages from 500,000. I want to check this. Thanks
Getting Started | | SJMDT0 -
4XX Client Error Solution?
Hello. Could you tell em how I can solve the 4XX client error from the moz crawl? I have the broken links in moz crawler like this: test.com/page-1/test.com. Thanks.
Getting Started | | iulianafun0 -
Mozbot Can Not Crawl Entire Domain
I'm trying to crawl Redken.com in Moz Analytics and the Search Diagnostics is only crawling 4 pages. The domain uses a "select your country" the first time you visit, and it seems as though the bot is not getting beyond that (aka, not clicking on "USA") and is therefore not crawling the rest of the domain. There is no country specific URL other than redken.com. I've tried entering both "redken.com" and "www.redken.com" as the URL, but no luck. Any tips?
Getting Started | | LabeliumUSA0 -
Crawl Diagnostics Help
Hi there Where can i find my campaigns crawl diagnostics? I need to find where this information can be found and specific issues? Is this possible, i cant seem to find this info. regards Ana
Getting Started | | Starsia200000 -
MOZ Starter Crawl not happeneing
Hi I added a new site 48hours + ago and the starter crawler has not even begun collecting data. Any help would be appreciated. cheers Isaac
Getting Started | | sodafizz0 -
Cant download my crawl csv
When I click on the [download csv] in my crawl campaign section nothing happens.
Getting Started | | digitalmedialounge0