"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz crawler not crawling on my site
Hi all, im facing an issue where moz crawler is unable to crawl my site. The following error keeps showing Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. This is my robots.txt file : https://www.wearefutureheads.com/robots.txt I'm not sure what else am I missing.. can anyone help
Product Support | | teikh0 -
Link to Moz Pro home 404s, and then I stumbled upon Moz's staging site...
I'm wary of giving more information as it's probably best that little to no one be able to access Moz staging for one reason or another. I should also mention that this was done very unintentionally on my part. That said, from the 404 from Moz Pro home, I tried to access "My QA", and that's when I realized that everything I did thereafter was within staging.moz.com (and posted a question similar to this one). Does Moz permit access to their staging site, or did I stumble upon a mistake - or Moz-stake, if you will?
Product Support | | Lumina0 -
Keeping getting the same results for "link opportunities"
After solving my 404 error, the results in 'link opportunities' are still the same. How do i refresh the site and get updated results?
Product Support | | kevinbp0 -
Cannot Access Moz Analytics
I've been trying to access Moz Analytics for over a month but have continued to see this error message: http://screencast.com/t/GMnN6l9WEI tried on all browsers and cleared my cache. The login works, because I am able to access it on other computers but not on my primary computer. This leads me to believe that Moz' servers are blocking out my computer's IP address for whatever reason.I've tried emailing the help team and calling but have not gotten any sort of response so far. Anyone have a solution?
Product Support | | EvolveDigitalLabs1 -
Unable to Access my Unfinished Campaign
Hello all, I tried to create a campaign for one of my clients but something happened and I had to stop somewhere in the middle. I tried to recreate it but it shows me the following message: “Oops, you already have a campaign named Willoby's Furniture. Please select a unique name for this campaign”. My problem is that I can’t access or see the unfinished campaign. A solution would be to create a new campaign and give it a different name. However, I would prefer to use this space for another client. Any suggestions? Many thanks, Elsa
Product Support | | OptimiseWeb0 -
The websites I add to my Moz Analytics account do not appear in the old "Pro" account. What is going on here?
The websites I add to my Moz Analytics account do not appear in the old "Pro" account. What is going on here?
Product Support | | GameDay1 -
How do I access my Full SERP Analysis Report in the new Moz?
Another possibly dumb question... I ran a full SERP analysis report and had it emailed to me, but in the email there's no link to the report. I logged back into Moz, but I can't find the report anywhere. Thanks! BiDFIvG
Product Support | | ScottShrum1 -
Giving access to a new user
We are looking to give access to a different user in our org, but when they try to log in on a different device, it's not working. The only device that can log in is mine. Please advise...
Product Support | | linkupSEO0