Unsolved The Moz.com bot is overloading my server
-
. How to solve it?
-
maybe crawl delay will help.
-
@paulavervo
Hi,
We do! The best way to chat with us is via our contact form or direct email. We also have chat within Moz Pro.
Please contact us via [email protected] or https://mza.seotoolninja.com/help/contact
We will be happy to help.
Cheers,
Kerry. -
very nice brother i like it very good keep it up !
-
very nice !
-
does the moz team even monitor this forum?
-
If the Moz.com bot is overloading your server, there are several steps you can take to manage and mitigate the issue effectively. First, you can adjust the crawl rate in your
robots.txt
file by specifying a crawl delay for the Moz bot using directives likeUser-agent: rogerbot
andUser-agent: dotbot
, followed byCrawl-delay: 10
to make the bot wait 10 seconds between requests. If this does not suffice, you can temporarily block the bot by disallowing it in yourrobots.txt
file. Additionally, it's a good idea to contact Moz’s support team to explain the issue, as they may offer solutions to adjust the crawl rate for your site. Implementing server-side rate limiting is another effective strategy. For Apache servers, you can add rules in your.htaccess
file to return a 429 Too Many Requests status code to the Moz bots, while for Nginx servers, you can set up rate limiting in your configuration file to control the number of requests per second from a single user or IP address. Monitoring your server’s performance and log files can help identify specific patterns or peak times, allowing you to fine-tune your settings. Furthermore, using a Content Delivery Network (CDN) can help distribute the load by caching content and serving it from multiple locations, reducing the direct impact on your server caused by crawlers. By taking these steps, you can manage the load from the Moz.com bot and maintain your server’s stability and responsiveness.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz is showing a canonical error that dont belong.
Hi guys, and thanks for this excellent source of information. i have an issue with the moz system because is telling to me that i dont have canonical instructions but i have canonical instructions on all my pages, so... im confused because maybe im not understanding what the system want to show to me. if you can help me i will be very gratefull. here you can see a page that have the canonical instruction. https://drive.google.com/file/d/14U_-Sgu_NQaB7kMBH3AguHQMHyHX9L8X/view?usp=sharing and here you can see what is reporting to me the MOZ system. https://drive.google.com/file/d/1pqgSC-V9WOyBPvQEr06pbqpLf_w7-q8J/view?usp=sharing this is happening on 19 pages, and all the 19 pages have the canonical instruction.
On-Page Optimization | | b-lab
thanks in advance guys.0 -
Unsolved MOZ Crawler Stalled
MOZ crawl has been waiting since April 2nd. Whats the deal? I am not able to "recrawl", so i have been stuck in limbo.
Product Support | | WebMarkets0 -
Unsolved Why is'nt there an update yet!
0 -
Why is my page ranking lower when my moz stats are higher?
There are several keywords that I search for and I notice we rank lower than a couple of competitors. When I use the mozbar and view the stats, I see that are PA and DA are higher and in some instances the ones who rank higher don't even show all the keywords in their meta descriptions. If this is the case, how are they still ranking higher?
Moz Pro | | Smart_Start0 -
Is there a way to get moz keywords analysis % through the api ?
I'm looking to integrate moz keywords analysis grade (in %) into my keyword research spreadshit as a column. Is there a way to get the % through the API ? Thanks
Moz Pro | | Sindicic_Alexis0 -
What do the dates refer to in seo moz reports
question is in the title - new trainee asked me and couldn't actually answer!
Moz Pro | | Highlandgael0 -
SEO Moz (organic) rankings keep being wrong
<colgroup><col width="129"> <col span="2" width="65"> <col width="91"> <col width="65"></colgroup>
Moz Pro | | adriandg
| Keyword | Organic | Local | SEO Moz Organic | SEO Moz Local |
| Storage scarborough | 1 | 1 | >50 | 1 |
| storage mississauga | 1 | 1 | > 50 | 1 |
| mississauga storage | 2 | 1 | > 50 | 1 |
| Storage toronto | 3 | > 50 | 2 | >50 |
| toronto storage | 3 | > 50 | 2 | 50 | One thing to note is we measured this on the google.ca which is also what we have setup in our campaign settings. This isn't the first time we have noticed inconsistencies, is there any way to resolve this in future ranking reports?0 -
Seomoz toolbar - Server location
Hello, We target french countries and it seems IP server location is important. So we took some hosting at Planete Hoster (located in Canada) with French IP, but our seomoz toolbar says our website is located in Canada 😞 See: http://www.aupaindantan.fr/ Could you please explain? do we need to change the hoster and to take one in France or this one is ok? Thank you for your answer
Moz Pro | | ahernoux0