Only few pages (308 pages of 1000 something pages) have been crawled and diagnosed in 4 days, how many days till the entire website is crawled complete?
-
Setup campaign about 4-5 days ago and yesterday rogerbot said 308 pages were crawled and the diagnostics were provided. This website has over 1000+ pages and would like to know how long it would take for roger to crawl the entire website and provide diagnostics. Thanks!
-
If this is your first campaign I highly recommend looking through the info here:
http://www.seomoz.org/help/crawl-diagnostics
It's a good overview of what the report you'll get is all about.
-
Thanks for the update, I was a bit concerned because of the discrepancy with rogerbot & screamingfrog. Will wait as mentioned and provide an update accordingly. Thanks for the headsup on diagnostics will wait for a full and complete report.
-
That is just the initial crawl to help get you started. (generally 250 pages or so). Depending on the day of your campaign setup, that is the day of the week that Roger will run all the reports under your campaign. If you started your campaign on Monday, then Monday will be the day that Roger will do his thing. If you started on Tuesday, etc...
If you don't have more pages crawled after your first full run, then let us know and we'll see what it is. Generally it is a linking situation if Roger can't see all of your pages. But, I would let the reports run before I started to diagnose anything.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Having 1 page crawl error on 2 sites
Help! A few weeks back, my dev team did some "changes" (that I don't know anything about), but ever since then, my Moz crawl has only shown one page for either http://betamerica.com or http://fanex.com. Moz service was helpful in talking about a redirect loop that existed, and I asked my team to fix it, which it looks to me like they have. Still, 1 page. I used SEO Book's spider tool and it also only sees 1 page, and sees the sites as http://https://betamerica.com (for example), which is just weird. I don't know enough about HT Access or server stuff to figure out what's going on, so if someone can help me figure that out, I'd appreciate it.
Moz Pro | | BetAmerica0 -
How to monetize a video website ?
My website is popularvid.com I want to monetize it just like youtube but i don't know how to do that. Please give me suggestions to monetize my video website. How to make my website rank page one google? Please give me brilliant ideas about new features to be added that will make my website beautiful. I'm a newbie here. Thank you
Moz Pro | | idamardyana0 -
Website is not being indexed in Mozscape
Hi, We launched a website Mid-March. Strangely it's not yet being indexed by the Mozscape crawler (therefore I can't use tools like Open Site Explorer). Open Site Explorer keeps telling me: "No Data Availible for this URL". I don't think it's a crawl error of some sort. Google Webmaster tools tells me everything is fine (no crawl errors). Search Engine indexing is also fine. Any thoughts on this? Thanks.
Moz Pro | | Vendic0 -
SEomoz slow to crawl?
Hello - I am just trying out the trial and it said the next crawl was nov 1st but I see no change in any of the errors since the initial crawl... so just waiting to find out if what I changed was fixed or not. Is this normal ?
Moz Pro | | Bethany_BabyBrowns0 -
SEOmoz crawl error questions
I just got my first seomoz crawl report and was shocked at all the errors it generated. I looked into it and saw 7200 crawl errors. Most of them are duplicate page titles and duplicate page content. I clicked into the report and found that 97% of the errors were going off of one page It has ttp://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20 http://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20__quickjump__A__name_box__begins__name__A__quickjump__E etc Has 20 pages of slight variations of this link. It is all my members list or a search of my members list so it is not really duplicate content or anything. How can I get these errors to go away and make search my site is not taking a hit? The forum software I use is IPB.
Moz Pro | | NoahGlaser780 -
Domain vs Page
I see a lot of different metrics pointing to domain or page. What is the difference between these two definitions?
Moz Pro | | Gfrink0 -
Dismiss crawl diagnostics error
Hello everyone, Is there a way to dismiss some errors in the Crawl Diagnostics tool so they don't appear again? It happens so that some of the errors are never going to be fixed because of their nature. For example, 'Title too long' errors that point to some of the threads on my forum - it doesn't make sense to change the title of a thread posted by user just for the sake of the error disappearing from the 'Crawl Diagnostics' tool. 🙂 Otherwise the CD interface gets a little bit cluttered with errors which I will never fix anyway. I wonder how others deal with this problem. Thanks.
Moz Pro | | MaratM0 -
Company Name in Page Title creating thousands of "Duplicate Page Title" errors
I am new, and I just got back my crawl results (after a week or more). The first thing I noticed is that the "duplicate page title" is in the thousands, my urls and page titles are different. The only thing I can see is that our company name is at appended to the name of every title. I did search and found one other person with this problem, but no answer was given. Can anyone offer some advice? This doesn't seem right... Thanks,
Moz Pro | | AoyamaJPN0