How long after a URL starts showing a 404 does Google stop crawling?
-
Before hiring me to do SEO, a client re-launched their site and did not 301 the old URLs to the new. Only the home page URL stayed the same.
For a month after the re-launch, the old URLs returned a 404. For the next month, all 404 pages (basically any non-existent URL) were 301'd to the home page. Finally, 2 months after launching, they properly 301'd the old URLs to the new.
Now, the new URLs are not ranking well. I assume it's too late to realize any benefit from the 301's, just checking to see if anybody has any insight into how long Google keeps trying to crawl old/404/improperly 301'd URLs.
Thanks!
-
Thanks for the responses. I tend to agree, but my concern is the "permanent" nature of a 301. I assume they will re-crawl the old URLs and replace the previous redirects with the new ones eventually.
-
Agree. Google will follow the links. Keep checking webmaster tools and 301 the pages Google can't find. I can't see why you would not get the link value.
-
Google's crawlers follow links. As long as links exist, those links will be crawled, even if the link generates a 404 error. They could choose to follow known 404 links less frequently, but they will still make attempts to follow the link.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I have updated title 4 days ago but still still showing old title and description on Google serps, How to resolve it?
I have updated the title tag but not showing, Please have look at the view source for this website- https://m.yolobus.in/ I want to show this title and description- <title>Online Bus Ticket Booking | YoloBus India</title> But showing the wrong title and description on google SERP- Title - YoloBus :: Home Description - Delhi Lucknow; Lucknow Delhi; Delhi Gorakhpur; Varanasi Lucknow; Gorakhpur Delhi; Delhi Delhi; Bangalore Bangalore; Manali Manali; Chennai Chennai 7mHsdmu
On-Page Optimization | | AnkitS.19900 -
Google finding my meta descriptions
I recently had my site redone (about a year ago). Since then google has not been using my meta descriptions much and more so using the descriptions within my site. Is there a reason for this? An example would be http://www.waikoloavacationrentals.com/vrp/unit/kolea-14/
On-Page Optimization | | RobDalton0 -
Google Is Ranking the Wrong Page
Howdy Folks- I have a case where Google is ranking the wrong page for a couple of different keywords. The home page is: http://healthtn.com Most notably, we're trying to optimize the home page for "Tennessee Health Insurance" but the below page is what continually ranks for it, and does so very poorly. We used to be page two with the home page, now we are page four and it ranks the following page. http://healthtn.com/tennessee/health-insurance/student I have started directing our Internal Linking to reflect the correct anchor text but succeeded in losing ranking for the term, but am still ranking the wrong page. Any thoughts or help would be much appreciated!
On-Page Optimization | | CRO_first0 -
Punctuation at the Start of Page Titles
one of my clients appears to be using an exclamation mark (e.g. "! Graphic Prints By Mirrorin - Fun Childrens Graphic Prints") and to be completely honest, I have no idea if this is bad practice or if it wont have any affect from an SEO point of view? Any help would be appreciated because it is site wide, therefore if it is an issue I would like to be able to get it sorted asap! Thanks
On-Page Optimization | | ZaddleMarketing0 -
Similar URLs
I'm making a site of LSAT explanations. The content is very meaningful for LSAT students. I'm less sure the urls and headings are meaningful for Google. I'll give you an example. Here are two URLs and heading for two separate pages: http://lsathacks.com/explanations/lsat-69/logical-reasoning-1/q-10/ - LSAT 69, Logical Reasoning I, Q 10 http://lsathacks.com/explanations/lsat-69/logical-reasoning-2/q10/ - LSAT 69, Logical Reasoning II, Q10 There are two logical reasoning sections on LSAT 69. For the first url is for question 10 from section 1, the second URL is for question 10 from the second LR section. I noticed that google.com only displays 23 urls when I search "site:http://lsathacks.com". A couple of days ago it displayed over 120 (i.e. the entire site). 1. Am I hurting myself with this structure, even if it makes sense for users? 2. What could I do to avoid it? I'll eventually have thousands of pages of explanations. They'll all be very similar in terms of how I would categorize them to a human, e.g. "LSAT 52, logic games question 12" I should note that the content of each page is very different. But url, title and h1 is similar. Edit: I could, for example, add a random keyword to differentiate titles and urls (but not H1). For example: http://lsathacks.com/explanations/lsat-69/logical-reasoning-2/q10-car-efficiency/ LSAT 69, Logical Reasoning I, Q 10, Car efficiency But the url is already fairly long as is. Would that be a good idea?
On-Page Optimization | | graemeblake0 -
How do I get other pages to show in SERPs
Why is it that when you google a domain like yahoo.com you sometimes get a main SERP and 6 sub SERPs below it. This concerns the 1st position.
On-Page Optimization | | ribandhull0 -
Should I let Google index tags?
Should I let Google index tags? Positive? Negative Right now Google index every page, including tags... looks like I am risking to get duplicate content errors? If thats true should I just block /tag in robots.txt Also is it better to have as many pages indexed by google or it's should be as lees as possible and specific to the content as much as possible. Cheers
On-Page Optimization | | DiamondJewelryEmpire0 -
Absolute vs Relative URLs
What are the pros and cons of these two types of URLs and what type of weight does this hold. It doesn't seem to be a big issue in regards to ranking. Any qualified clarity would help.
On-Page Optimization | | Romancing0