How long does it take for a campaign website crawl to be completed?
-
Our campaign website crawl has been 'crawling' now for 5 days. Is this a normal phenomenon or is something hanging up?
-
Thanks Nick!
Honestly, I have searched how I could address a technical question but up till now have not been able to find how to address a problem. Just a hint.
-
Hey There,
Thanks for writing in! This question is more suited for our help team at SEOmoz. I am going to create a ticket with your email address and this issue so we can take a look at it closer over there. If you have any other Tool related questions or problems with billing, etc, please email us at [email protected]. We will gladly be able to help you with any of those issues over there.
If you have any SEO related questions please don’t hesitate to ask on the QA community site!
Have a good one!
Nick
-
Next crawl in progress there for 5 days? Wow, no, unless you've got an absolutely huge site that shouldn't happen. I'd send in a trouble ticket.
-
That is actually what I am referring to: it says "Next Crawl in Progress" with the little beetle scrolling... but it has been doing this for 5 days straight now. It even says Crawl started on Feb 10.
So I am wondering, is it normal to be crawling for 5 days straight.
-
That is actually what I am referring to: it says "Next Crawl in Progress" with the little beetle scrolling... but it has been doing this for 5 days straight now. It even says Crawl started on Feb 10.
So I am wondering, is it normal to be crawling for 5 days straight.
-
Swing on over to your dashboard. Find your campaign, navigate to crawl diagnostics. Under the first errors/warnings/notices box you'll see something like:
Last Crawl Completed: Feb. 9th, 2012 Next Crawl Starts: Feb. 17th, 2012
Your dates, of course, will be different.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my site not crawl?
hi all me allow rogerbot in robots.txt but rogerbot can't crawl my site my site: toska-co.ir
Moz Pro | | jahanidawodi0 -
Initiate crawl
Anyway to start the crawl of a site immediately after changes have been made? Or must you wait for the next scheduled crawl? Thanks.
Moz Pro | | dave_whatsthebigidea.com0 -
If i have just started a campaign, and the crawl is happening - can i log off and shut down my PC
If i have just started a campaign, and the crawl is happening - can i log off and shut down my PC or will this cause the crawl to stop. My campaign was showing as "crawl in process". I then shut down and logged onto my SEOmoz account on another PC. When I did the crawl didnt seem to be in process, even though the total time was still about 30 min from the crawl start...... sorry if this is a stupid question, just a bit new to this
Moz Pro | | duff1010 -
Crawl Diagnostics Error Spike
With the last crawl update to one of my sites there was a huge spike in errors reported. The errors jumped by 16,659 -- majority of which are under the duplicate title and duplicate content category. When I look at the specific issues it seems that the crawler is crawling a ton of blank pages on the sites blog through pagination. The odd thing is that the site has not been updated in a while and prior to this crawl on Jun 4th there were no reports of these blank pages. Is this something that can be an error on the crawler side of things? Any suggestions on next steps would be greatly appreciated. I'm adding an image of the error spike Xovep.jpg?1 Xovep.jpg?1
Moz Pro | | VanadiumInteractive1 -
Pages Crawled: 250 | Limit: 250
One of my campaigns says: Pages Crawled: 250 | Limit: 250 Is this because it's new and the limit will go up to 10,000 after the crawl is complete? I have a pro account, 4 other campaigns running and should be allowed 50,000 pages in total
Moz Pro | | MirandaP0 -
Crawl slow again
Once again the weekly crawl on my site is very slow. I have around 441 pages in the crawl and this has been running for over 12 hours. This last happened two weeks ago (ran for over 48 hours). Last week's crawl was much quicker (not sure exactly how long but guessing an hour or so). Is this a known issue and is there anything that can be done to unblock it? Weekends are the best time for me to assess and respond to changes I have made to my site so having this (small) crawl take most of the weekend is really quite problematic. Thanks. Mark
Moz Pro | | MarkWill0