Who wants to help go over my crawl diagnostics via skype?
-
I have run a crawl diagnostic on my site and have 194 errors and most of them are 404 errors in wordpress. Not sure why, but many of my pages had name changes (possibly a permalinks issue) but I have no idea how to fix it.
- I had 5 duplicate page titles, and 1 tile missing or empty.
- 72 crawl notices found (2 permanent redirect, 17 blocked by robots, 53 rel canonical)
- 19 Crawl warnings were found
Who wants to have some fun?
-
Alright. Having over 100 errors and warnings had me worried. Sounds like its not that big of a deal. I did notice some issues where it looks like my blog page and some other pages are not being indexed. Any insight on this?
-
Your site seems to be in decent shape, based on the screaming frog crawl i ran
- You've got 2 internal 404 errors due to erroneous links you placed in the code probably
- your dupe titles don't look like they're a problem - canonical and no index tags seem to have sorted the issue
- page with a missing title is .php?Action=sitemap - doesn't seem to be the end of the world
The spider follows robots.txt
All in all, I wouldn't worry bout the warnings.
Mark
-
http://starkseo.com/downloads/
my skype is dfwnerdherd
-
Instead of Skype, why don't you download the PDF and upload it to your server, and then share the link. I'd like to take a look.
-
Zack, what's your site? I can run it through Screaming Frog and take a look at the sources for the 404 errors, and export the data for you, so you'll be able to go in and fix the links.
-
Hi Zack,
Have you checked out our Help Hub, where we have a lot of information about the Crawl Diagnostics tool and a video that walks you through it some of the features?
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why Only Our Homepage Can Be Crawled Showing a Redirect Message as the Meta Title
Hello Everyone, So recently when we checked our domain using a Moz Crawl Test and Screaming Frog only the homepage comes up and the meta title says “You are being redirected to…”. We have several pages that used to come up and when submitting them to GSC no issues come up. The robots.txt file looks fine as well. We thought this might be ‘server’ related but it’s a little out of our field of expertise so we thought we would find out if anyone has any experience with this (ideas of reasons, how to check…etc.) or any potential suggestions. Any extra insight would be really appreciated. Please let us know if there is anything we could provide further details for that might. Looking forward to hearing from all of you! Thanks in advance. Best,
Moz Pro | | Ben-R0 -
Need Help with www and non-www redirect
Hi everyone, I've been looking around the forum and found some similar topics but none of them have solved my problem. Anyway, I'm new to SEO and found that when I use Open Site Explorer for the www version of my site I see the links directed to my page, but none of my twitter stats show up. When I do the same for my non-www version. I see my twitter stats, but no links. Facebook seems unchanged. Also, the Page Authority is much higher for the www (I assume because of the links) It is my understanding that it doesn't matter which version of the domain is used, I just need to pick one and stick with it (on Google Webmaster Tools, etc.). And that I also need to do a 301 redirect for the version that I'm not using. The issue now is that I have a 301 redirect, and when I type in my url in any version (http, https, www, non-www) it all redirects in the browser without issue. So i know users are getting to the right page, but the Open Site Explorer still sees them as 2 different sites. My concern is that if Open Site Explorer sees it this way then Google may see it this way as well and I could be missing out on potential rankings. I'm currently doing the redirect in the .htaccess file. The redirect looks like this: RewriteEngine On
Moz Pro | | opstart
RewriteCond %{SERVER_PORT} 80
RewriteRule ^(.*)$ https://mydomain.com/$1 [R=301,L] Any Ideas on what I need to do to properly 301 redirect the site so that my preferred version can get credited with the links,twitter, and Page Authority stats? Also, I'm using wordpress and it has the URL set to the non-www version of the site. However, I think I would like to change this to the www version because most of the links are directing to www, and I also think people are more familiar with that format. Anyway, sorry for the long post. Any help would be greatly appreciated. Thanks.0 -
Help us with Moz Academy!
Hey Q&Aers! I just wanted to create a discussion thread here to talk solicit some feedback and help with Moz Academy! We want your help coming up with future lessons so we’re getting you the content you need. So, think about what you’d or your team would like to learn from Rand and others at Moz. Let us know! “So, what is Moz Academy?” you may ask. Well, Moz Academy gives subscribers the power to be better marketers, which will enable them to use Moz’s products with more depth and awesomeness. We want to provide a hub of marketing knowledge that will create a stronger community where people can teach each other while using Academy as a frame of reference. The key to this project is empowering you to kick even more ass than you already do! If you have any questions about Moz Academy, feedback about lessons, or ideas on a future curriculum please feel free to get involved in the discussion below. Looking forward to see what everyone comes up with.
Moz Pro | | Nick_Sayers1 -
I've got quite a few "Duplicate Page Title" Errors in my Crawl Diagnostics for my Wordpress Blog
Title says it all, is this an issue? The pages seem to be set up properly with Rel=Canonical so should i just ignore the duplicate page title erros in my Crawl Diagnostics dashboard? Thanks
Moz Pro | | SheffieldMarketing0 -
Crawl Errors Confusing Me
The SEOMoz crawl tool is telling me that I have a slew of crawl errors on the blog of one domain. All are related to the MSNbot. And related to trackbacks (which we do want to block, right?) and attachments (makes sense to block those, too) ... any idea why these are crawl issues with MSNbot and not Google? My robots.txt is here: http://www.wevegotthekeys.com/robots.txt. Thanks, MJ
Moz Pro | | mjtaylor0 -
Dynamic URL pages in Crawl Diagnostics
The crawl diagnostic has found errors for pages that do not exist within the site. These pages do not appear in the SERPs and are seemingly dynamic URL pages. Most of the URLs that appear are formatted http://mysite.com/keyword,%20_keyword_,%20key_word_/ which appear as dynamic URLs for potential search phrases within the site. The other popular variety among these pages have a URL format of http://mysite.com/tag/keyword/filename.xml?sort=filter which are only generated by a filter utility on the site. These pages comprise about 90% of 401 errors, duplicate page content/title, overly-dynamic URL, missing meta decription tag, etc. Many of the same pages appear for multiple errors/warnings/notices categories. So, why are these pages being received into the crawl test? and how to I stop it to gauge for a better analysis of my site via SEOmoz?
Moz Pro | | Visually0 -
Competitive .edu Research via Open Site Explorer
I was using open site explorer and trying to figure out how my competitors are getting so many .edu links. Now I won't mention any names here but I am trying to figure out why almost all their links point to downloads of documents. Here are a few of the examples of sites I keep finding... www.cs.uoregon.edu/research/paracomp/tau/monitor/sheehan_examples/tim_context_xmpl?wiki=TailleMaximaleDesFichiersSurUnePartition/orphan www.atmos.albany.edu/facstaff/mathias/video/090926_wima_klimawandel.ivr?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=American Journal Clinical Nutrition&rft.atitle=Problems with red meat in the WCRF2&rft.volume=89&rft.spage=1274&rft.epage=9&rft.date=2009&rft.aulast=Truswell&rft.aufirst=AS&rfr_id=info%3Asid%2Fwiley.com%3AOnlineLibrary faculty.unlv.edu/jensen/CEE_468/GISTutorialWorkbook/tutorial11/LandUsePgh.lpk?arrow=nws&read=24922 <colgroup><col width="3111"></colgroup>
Moz Pro | | MichealGooden0 -
Crawl Diagnostics and missing meta tags on noindex blog pages
Hi Guys/Gals We do love the Crawl Diagnostics, but do find the missing meta tags ("Missing Meta Description" Tag in this case) somewhat spammy. We use the "All in One SEO Pack" for our blog and it does stick in noindex,follow (as it should) on the pages that is of no use to us. "2008/04/page/2/" and the likes. Maybe I'm wrong but should the Diagnostics tool not respect the noindex tag and just ignore any warnings, since it should really mean that these pages are NOT included in the search index. Meaning that the other meta tags are really useless. Any thoughts?
Moz Pro | | sfseo0