Moz Crawler failing with https redirect?
-
Is there a way to get the Moz Crawl Test to work with HTTPS?
I just got back this error:
902 : Network errors prevented crawler from contacting server for page.
Site is set up with a standard 301 to redirect http to https - or at least I certainly hope it is!
Rex Swain's HTTP Header Checker took shows a standard 301.
Anyone else experiencing this error?
btw - this is both a specific question and an opportunity for open discussion...
Thanks!
-
Hi there - Kristina from Moz's Help Team here.
Unfortunately at this time our crawler isn't compatible with Server Name Indication (SNI), which appears to be in use on your site. In general, SNI is a totally acceptable security configuration, but our crawler simply isn't equipped to be able to handle these settings.
http://screencast.com/t/dB2C3eVJ7gN
I found this thread in our Community Q&A forum with lots of other users running into the same problem, so it's definitely something we're aware of and working to address: https://mza.seotoolninja.com/community/q/804-https-ssl-error
The good news is that a recent update has been made, and we're ready to accept beta SNI customers to test it out. Please see the article here that explains this further: https://mza.seotoolninja.com/community/q/moz-pro-our-web-crawler-and-sites-that-use-sni and if you're interested in being a part of the beta testing, the link to the sign up page is here: http://goo.gl/forms/LCvL9Ix8JDHfbAvr1
I apologize for the inconvenience in the meantime, but hopefully we'll have it fixed soon! Let me know if there's anything else I can do to help!
-
Hi There,
It seems that your server is blocking the Moz crawler as an activity that it doesn't recognize.
You should contact your hosting provider to get a solution. You can read a similar answer here
https://mza.seotoolninja.com/community/q/error-code-902-for-crawl-diagnostics
I hope this helps, please feel free to ask further questions.
Regards,
Vijay
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can someone give details about Moz Pro Tool in Depth ?
Hi, I have been using some other tool for my monthly SEO activities, due to my advice of friend, thinking to move to Moz Pro. Can Someone give the answers for the questions SERP Ranking Re-freshness ( For how often it would update ) Mobile SERP Ranking ( Whether the tool shows the SERP Rankings on Mobiles ) Backlinks ( Does Backlinks Data has the Historical Index ) Alerts ( The important thing i need was to get instant alerts on Rankings, Backlinks Toxic Score, so how often i would receive those alerts
Feature Requests | | NishanthRaj0 -
In Moz's Keyword Explorer/Explore By Site, Can I Exclude a Keyword From the Results?
Hypothetical question - Let's say I sell tax preparation software and I want to see the keywords that "turbotax.com" ranks highest for. Based on that list I might want to optimize for similar keywords on my site. But if I use Keyword Explorer, select "Root Domain", and enter "turbotax.com" as the root domain, the first 200 or so keywords in the list have the word "turbo". None of those interest me. Can I exclude certain keywords (like "turbo") from the list? Thanks.
Feature Requests | | CurtisB0 -
Moz crawler is not able to crawl my website
Hello All, I'm facing an issue with the MOZ Crawler. Every time it crawls my website , there will be an error message saying " **Moz was unable to crawl your site on Sep 13, 2017. **Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. " We changed the robots.txt file and checked it . but still the issue is not resolved. URL : https://www.khadination.shop/robots.txt Do let me know what went wrong and wjhat needs to be done. Any suggestion is appreciated. Thank you.
Feature Requests | | Harini.M0 -
MOZ Site Crawl - Ignore functionality question
Quick question about the ignore feature found in the MOZ Site Crawl. We've made some changes to pages containing errors found by the MOZ Site Crawl. These changes should have resolved issues but we're not sure about the "Ignore" feature and do not want to use it without first understanding what will happen when using it. Will it clear the item from the current list until the next Site Crawl takes place. If Roger finds the issue again, it will relist the error? Will it clear the item from the list permanently, regardless if it has not been properly corrected?
Feature Requests | | StickyLife1 -
How to solve Moz crawl error?
I want to crawl one of my eCommerce website. In my google webmaster account, there is not crawl error. But when I want to check crawl by Moz it shows error. I have made this ecommerce site with prestashop. Google still rank up my loacal keywords. Can anybody suggest me by checking Moz crawler error by checking my online shop.
Feature Requests | | Shamimgypsy0 -
Including "Volume" on the Tracked Keywords Overview Page in Moz Pro
I've searched Q&A but I did not see where this question has been asked before, so hopefully I'm not repeating a question that has already been asked (and answered). For the past couple of years I have been using Conductor Searchlight as our SEO toolset, however recently I have made the decision to switch to Moz Pro. My question is regarding the Tracked Keywords Overview Page. In the current display, the Overview Page shows Keyword, Location, Universal Results, Rank, URL and Optimize. Has there every been any consideration to also include Volume? One of the nice features of CS Keyword Overview page was that I was able to view the rank of all my keywords, and the volume of each, at the same time. We currently track 275 keywords. Some keywords are obviously more important than others. The CS Overview Page allowed me to quickly scan through the list of keywords, see the ones that were within striking distance of page one (by rank), and since I could also see the volume at the same time, it also allowed me to prioritize which keyword to focus on. If two keywords were both ranked "11", but one had triple of volume of the other, it makes sense to focus on the one with the greater volume. From Moz's Tracked Keywords Overview Page I can drill down and get the "Volume" information that I'm looking for (and lots of other really good information), but I have to do it for each individual keyword. Moz Pro is a great SEO tool and the information available is amazing. The switch from CS has been an easy one, but CS did have some features that I liked, and being able to see both rank and volume on the Overview Page was one them. Any information, suggestions, or work-arounds regarding my question is appreciated. Regards Scott
Feature Requests | | WScottDuncan0 -
High Priority - Error Code 804: HTTPS (SSL) Error Encountered
I know that Rogerbot has an issue with SSL / SNI technology used with our Amazon Cloudfront setup even though most browsers support it. Is there a timeframe for this to be fixed? If not is there a specific set of instructions or any way for us to get this from showing up on our High Priority list? Thanks! Sean
Feature Requests | | zspace0 -
Suggestion to Improve Moz's Link Data
Hello All. The recent Index update (29th January) seems to have produced quite a few shocks to Moz Pro users. Index updates always cause panic and joy every time they are released. However, I feel this is a big improvement that could be made. In this last index, the DA for my site has remained the same. I was expecting a rise, simply because I have been doing some link building since October and was expecting the results to start showing around this time. However, the link metrics for my site looked worse this month than ever before. The index clearly didn't crawl sites and pages that it has crawled the last couple of indexes, and I noticed a few links disappeared from the metrics altogether, links that I know still exist. So I have a suggestion... If Moz has collected link data in previous indexes, can it not preserve that data rather than starting afresh with every new index. Regular checks could be conducted on existing link data to identify expired or broken links, but to disregard them and start anew with every index seems a little odd. That way, Moz would have much more accurate and comprehensive link data which would help to avoid the DA inaccuracy, and provide users with a better measure of how their site is performing against the rest of the web. This may be naive because I do not know the technical side to index updates. Any thoughts, advice, suggestions etc would be appreciated.
Feature Requests | | AHC_SEO0