7 Days into My Account and Only Crawled 3 Pages - What's Happened?
-
Am I doing something wrong? So far only 3 pages of my site have been crawled - but my account has been live for 7 days. Would it tell me if it was having trouble crawling the rest of the site?
-
Gerard,
The first question that comes to mind is do you have https pages on the site? Moz crawlers do not crawl https, so if the site has a lot of these, it would be a problem.
If that is not the issue and you have had the campaign up for 7 days, you should let SEOmoz know. When we do campaigns, we get initial results really quickly (an hour or two generally) and the full crawl within 7 days. On the site it states up to 250 pages crawled immediately (within two hours) and up to 10,000 within 7 days.In the top right of this page is a button with Help. Click it and there are numerous ways to get assistance. SEOmoz is always very responsive and you will likely have an answer once someone is in the office. They are Pacific time so consider that.
Best,
-
Here are some reasons why just there may be trouble crawling a site. http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page. My suggestion is to open up a help desk ticket (email [email protected]) and let them know which campaign you're having trouble with. They can go take a look at your site and see if there's something preventing Roger from crawling.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
A tale of two pages - one ranks great and one doesn't - but they are set up the same way
Hi everyone, First time poster 🙂 I will keep it simple - we have two pages on our website that are set up in the same way (or so we think) but achieve vastly different search engine rankings. We have spent weeks trying to figure out why this should be the case, but to no avail. Perhaps you guys can do a little diagnosis and see what we are missing: for search term: used machine tools www.machinetoolsonline.co.za/buy-used-machine-tools Is working well for us. for search term: new machine tools www.machinetoolsonline.co.za/buy-new-machine-tools is a disaster 😞 In fact, Google ranks our home page which is optimised for other terms, higher. Any ideas would be appreciated. Thanks!
Moz Pro | | Delorentis210 -
How often does seomoz crawl the site? Can you force a crawl at a specific time ?
How often does seomoz crawl the site? Can you force a crawl at a specific time ?
Moz Pro | | stewbuch18720 -
Massive Rank Changes in Bing/Yahoo Only - What's up w/ Rank Tracker?
I'll be honest, it's pretty shameful how little attention I give Bing and Yahoo. But something recently caught my eye - I have a client who according to rank tracker is all over the place in yahoo/bing...up 20 positions for some kw's, down 12 for others...meanwhile Google's holding steady, and Google data seems mostly accurate - with one exception of showing 46th position for an exact match branded search that they're #1 for. I know Rank Tracker has been going through some fine tuning, right? I don't manually check Yahoo/Bing - I can't imagine those #'s are accurate though. Am I right to assume it's incorrect data? Just curious, any insight would be much appreciated. Thanks
Moz Pro | | SVmedia0 -
My Website is not being crawled by Google last 15 days
Hello, Required emergency help, one of client website http://www.mediaxpress.net/ is not being crawled since last 15 days, What can be the reason. I have Checked Google Webmaster Tools, it not showing an Issue and even SEOmoz crawler is crawling it normally. I have updated some data on pages, and i want to get it crawled by Google. But Google is not crawling in anyway.
Moz Pro | | CommercePundit0 -
Crawl Diagnostics Summary
Sorry if I am not asking in the right place. On Crawl Diagnostics Summary it says this right..?? : "To get you started quickly Roger is crawling up to 250 pages on your site. You should see these results within two hours. The full crawl will complete within 7 days.". so it's passed a day and it still doesn't show nothing. It says "Processing Crawl Data for 358 pages" How much should i wait??
Moz Pro | | Dussk0 -
Do Google's recent changes effect the data SEOmoz delivers
Since Google made privacy changes and certain keyword tools such as MS have had to make drastic changes to continuing to be usefull, has SEOMoz encountered any problems and is your keyword data as reliable and accurate as before the Google change?
Moz Pro | | penandzeke0 -
Can I change the crawl day ?
Hi All I hope there is a simple solution to this - we have a number of campaigns setup which are all crawled, and therefore updated, on different days of the week. We review these weekly and it would be much easier if they were all crawled on the same day. Is it possible to change the crawl day for some campaigns? Thanks Roy
Moz Pro | | bluelogic0