When will Dotbot see changes to my robots.txt file?
-
Dotbot doesn't want to know anything about my site, my Page Authotize is still 1 and my DA is the same. How long does it take to start getting results? In all the websites we have been working on, we have no problems, but in ours it has come up.
-
Thank you very much for your response, the truth is that we are appearing in different advertising media, and google has the links indexed. In fact we have now added the url to our moz profile and added it to the Link Tracking Lists tool.
It will be a matter of time
-
Hi - thanks for contacting us,
When you see a DA of 1, this will usually mean that we haven't indexed that site yet or we haven't found any inbound links for that particular site. That can happen for a number of reasons, such as we haven't found any external links to the site or the site is blocking our crawler or the site is fairly new.
When we compile our index by first crawling the more valuable pages we find and moving on from there. Specific pages may not be crawled if they have lower quality links on them or appear to be part of an unintentional link farm (for example, things like programmed calendars). If you’re wondering why we’re not identifying links to your site, I would suggest checking to make sure we’ve indexed the sites and pages you know are linking to your site.
Also, it’s important to keep in mind that with Link Explorer, new data is added all the time, so please keep an eye out for new data to be available for your site!
I hope this helps - please let me know if you have any other questions!
-
Hi there,
You just need to wait for a little bit longer, so Moz can crawl your site. Meanwhile, you check all your links in Google Search Console.
Ross
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How long will it take for google to reindex 301 redirected url and refresh search results with new urls.
We have set up 301 redirects for some subdomains which we are planning to use, but then we changed our focus to main domain. Google has already crawled some of the subdomain pages. As it was duplicate content over subdomains and main domain, we have set up 301 redirects for all subdomains to redirect to the main domain. We have set up 301 redirects a month ago, but some of the search results still show old URLs. Do you need something extra for google search results to refresh with main domain and remove subdomain URLs from google searches? We need rankings to be passed new URLs.
Link Explorer | | swapnil120 -
Crawl a node js page - Why can I only see my frontpage?
Hi When i am trying to crawl my website ( https://www.doorot.com/ ) it can only find my frontpage. It's a node js page. Any one had the same problem or know how to crawl my site in order to see all my pages? Kasper
Link Explorer | | KasperClio1 -
Will Moz move DA from an old domain to the new?
Hi folks, I'm moving a digital magazine of mine, which has a great deal of authority (DA53!) to a new domain, which is much more brandable. I'm curious if Moz ever passes the actual DA/PA numbers to the new domain. Does the tool pick this up, eventually? I know once the domain is switched, DA will show a "1" -- as the domain is brand new, technically. This is NOT a question about authority/link juice being passed, but rather the numbers being displayed by Open Site Explorer. Some authors do look at Moz DA as an indicator of a sites "power" before applying for authorship, so I'm trying to find a way to move to a more brandable domain, while keeping the OSE stats in place. If it's not possible, I'll have to live with it 🙂 Any input? Thanks everyone!
Link Explorer | | avilawebfirm0 -
Change in OSE?
Hi My site http://sassandgrace.co.uk has a 301 direct from the www. version as recommended and, up until last week, OSE showed no results for the www version with a message of some kind saying about the re-direct. This week the message has disappeared and I have half my links (still v small) on www version and half on the non version. Has something changed? Should I be worried? And what, if anything, should I do? Thanks
Link Explorer | | Sassandgrace0 -
Backlinks to pdf files
hi.. im looking for solution how to get all backlinks to .pdf files on my site.
Link Explorer | | tybi-seochat
to get list of .pdf files with backlinks. and for them list of backlinking urls. thanks a lot0 -
Error Code 612 with robots.txt 200
Hi! I am getting this message Error Code 612: Error response for robots.txt, so the crawler do not check any page of the site. The status code for the robots.txt is 200 and it does not seem Googlebot has any problem crawling the site, so I don't know what the matter is. The site is http://www.musicopolix.com/ Thanks so much in advance for any help!
Link Explorer | | Musicopolix0 -
I have a robots.txt error on Moz but not on Google Webmaster tools. Wondering what to do.
For the site www.patrickwerry.com, I'm getting a DA of 1 and a Error Code 612: Error response for robots.txt However, when I check webmaster tools, it's showing no errors and allowing robots.txt for the domain. Is there anything I can do to fix the issue on the Moz side so I can get better data? If you can respond in layman's terms even better. 🙂 Not an SEO. Lisa
Link Explorer | | LisaGerber0