When will Dotbot see changes to my robots.txt file?
-
Dotbot doesn't want to know anything about my site, my Page Authotize is still 1 and my DA is the same. How long does it take to start getting results? In all the websites we have been working on, we have no problems, but in ours it has come up.
-
Thank you very much for your response, the truth is that we are appearing in different advertising media, and google has the links indexed. In fact we have now added the url to our moz profile and added it to the Link Tracking Lists tool.
It will be a matter of time
-
Hi - thanks for contacting us,
When you see a DA of 1, this will usually mean that we haven't indexed that site yet or we haven't found any inbound links for that particular site. That can happen for a number of reasons, such as we haven't found any external links to the site or the site is blocking our crawler or the site is fairly new.
When we compile our index by first crawling the more valuable pages we find and moving on from there. Specific pages may not be crawled if they have lower quality links on them or appear to be part of an unintentional link farm (for example, things like programmed calendars). If you’re wondering why we’re not identifying links to your site, I would suggest checking to make sure we’ve indexed the sites and pages you know are linking to your site.
Also, it’s important to keep in mind that with Link Explorer, new data is added all the time, so please keep an eye out for new data to be available for your site!
I hope this helps - please let me know if you have any other questions!
-
Hi there,
You just need to wait for a little bit longer, so Moz can crawl your site. Meanwhile, you check all your links in Google Search Console.
Ross
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
How spam score will be calculated for the domain without any content or backlinks?
Hi Moz team, I have noticed that one of our old domain has high spam score of 9. This has been redirected to our domain around 2 years back. I can see that old domain doesn't have any back links. Then how come the spam score have been calculated for this? If there is any metric for this, we just wanna remove redirecting this spammy old domain to our domain. Please clarify. Thanks
Link Explorer | | vtmoz0 -
Will Moz move DA from an old domain to the new?
Hi folks, I'm moving a digital magazine of mine, which has a great deal of authority (DA53!) to a new domain, which is much more brandable. I'm curious if Moz ever passes the actual DA/PA numbers to the new domain. Does the tool pick this up, eventually? I know once the domain is switched, DA will show a "1" -- as the domain is brand new, technically. This is NOT a question about authority/link juice being passed, but rather the numbers being displayed by Open Site Explorer. Some authors do look at Moz DA as an indicator of a sites "power" before applying for authorship, so I'm trying to find a way to move to a more brandable domain, while keeping the OSE stats in place. If it's not possible, I'll have to live with it 🙂 Any input? Thanks everyone!
Link Explorer | | avilawebfirm0 -
Change in OSE?
Hi My site http://sassandgrace.co.uk has a 301 direct from the www. version as recommended and, up until last week, OSE showed no results for the www version with a message of some kind saying about the re-direct. This week the message has disappeared and I have half my links (still v small) on www version and half on the non version. Has something changed? Should I be worried? And what, if anything, should I do? Thanks
Link Explorer | | Sassandgrace0 -
Why can i see domain links for competitors form social media sites such as pinterest and youtube but not for myself??
When doing competitor analyse i can see that they are getting domain links form youtube and pinterest yet when i analyse my own links i do not have these. My Google analytics shows me that iam getting traffic from these sources so why is it not showing up for me? and is this affecting my moz rank?
Link Explorer | | RobAdair10 -
Error Code 612 with robots.txt 200
Hi! I am getting this message Error Code 612: Error response for robots.txt, so the crawler do not check any page of the site. The status code for the robots.txt is 200 and it does not seem Googlebot has any problem crawling the site, so I don't know what the matter is. The site is http://www.musicopolix.com/ Thanks so much in advance for any help!
Link Explorer | | Musicopolix0 -
See Lost Links?
My Moz analytics campaign says i have lost some links since the last crawl on one of my sites, Is there an easy way in moz to see which links these are i lost and where from? James
Link Explorer | | Antony_Towle0 -
Changed URL from HTTP to HTTPS - 99% of my backlinks don't know though
Hi Moz community, I've got a question about all old backlinks pointing to the http version of my site: Firstly, how it impacts my site's backlinks for SEO and secondly, why does Moz and if you know why Majestic have different metric report values for the different URLs. The Back Story Two months ago I bought an SSL for my personal domain and changed my URL from http to the https version. I 301'd it and can verify that on Majestic SEO using the old http URL. I did this sitewide for an eCommerce site that I'm working and did see a lift in traffic; that was the main reason based on Google talking about sites moving to the SSL Web. I'm No Stranger to 301s Of course all the URLs on my site have been 301'd. I used a HTTPS Redirect plugin for my WordPress site and there's been no issue. I also installed a 404 Checker plugin to log broken external links to my site where I can create a redirect right away in case the HTTPS plugin missed something along the way. I'm comfortable knowing that doing when you change the domain name for a site or just a page going from one URL to another will transfer all the link equity over time. What's Causing the Confusion What's a little confusing is that when I use tools like OSE or Majestic's Explorer, the data doesn't match. For instance in OSE, the https version of my domain has a DA of 1 and PA of 1. But, the http version of my site has a DA of 25 and PA of 36. With Majestic (BTW, please feel free to stop me from asking questions about another tool on Moz, but since we're all part of the same SEO community, I thought I'd ask it here anyway) the Trust and Citation flow values are definitely closely matched but still different values nonetheless. My Question Will I ever see the DA and PA the same for the https & http versions in the future? Does OSE catch the fact that there is a 301 redirect to the https version or does it only recognize that it redirects from http://kingrosales.com to http://www.kingrosales.com when in fact it redirects to https://www.kingrosales.com? My second question is, what about the backlinks? Is it because they are different URLs that OSE doesn't have a way to recognize this and display links from the old http version to the new https version? How will I know the true PA and DA of the https version of my site even with a perfectly executed 301 redirect? lol Let me know if you need more clarification. Thanks
Link Explorer | | KingRosales3