Mobile Googlebot vs Desktop Googlebot - GWT reports - Crawl errors
-
Hi Everyone,
I have a very specific SEO question. I am doing a site audit and one of the crawl reports is showing tons of 404's for the "smartphone" bot and with very recent crawl dates. If our website is responsive, and we do not have a mobile version of the website I do not understand why the desktop report version has tons of 404's and yet the smartphone does not. I think I am not understanding something conceptually.
I think it has something to do with this little message in the Mobile crawl report.
"Errors that occurred only when your site was crawled by Googlebot (errors didn't appear for desktop)."
If I understand correctly, the "smartphone" report will only show URL's that are not on the desktop report. Is this correct?
-
Hey Carla,
I'm not entirely sure what you're saying with:
"one of the crawl reports is showing tons of 404's for the "smartphone" bot and with very recent crawl dates. If our website is responsive, and we do not have a mobile version of the website I do not understand why the desktop report version has tons of 404's and yet the smartphone does not. I think I am not understanding something conceptually."
You say that the smartphone bot is seeing tons of 404s and the desktop report is showing tons of 404s, but the smartphone does not. If you can clarify that, I can probably better answer your question.
However, the answer is likely that Google may decide not to crawl URLs that it has already identified as 404s in one context. That is to say if they identify URLs on the mobile device as 404s they will know not to crawl them if they encounter them on desktop and vice versa.
-Mike
-
Ok I forgot to add something to this as well. Why would the URLS show up on the smartphone report if they are not on the desktop report? Afterall a 404 from either device is still a 404?
Thanks
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Anchor Text vs. Button Links
Hi How important are anchor text links within your own site vs. buttons for SEO? We've redesigned some of our pages from anchor text links to buttons which are just clickable images.I know historically this isn't the best way, but is it still as important as it used to be?
Intermediate & Advanced SEO | | BeckyKey0 -
Onsite SEO vs Offsite SEO
Hey I know the importance of both onsite & offsite, primarily with regard to outreach/content/social. One thing I am trying to determine at the moment, is how much do I invest in offsite. My current focus is to improve our onpage content on product pages, which is taking some time as we have a small team. But I also know our backlinks need to improve. I'm just struggling on where to spend my time. Finish the onsite stuff by section first, or try to do a bit of both onsite/offsite at the same time?
Intermediate & Advanced SEO | | BeckyKey1 -
GWT, Editing URL Parameters for Ecommerce Features
I have had the setting of "let googlebot decide" on managing my URL parameters on an Ecommerce site in Magento. The products I sell come in different sizes and colors and finishes etc. These parameters are showing up in Google Webmaster Tools and set for "let googlebot decide". Some of them have as many as 8 million urls monitored. I changed the editing option to clam these parameters as "narrow searches", but still left the option to "let googlebot decide" (versus block urls). Will blocking these erroneous urls serve any benefit? Does blocking these help with the crawl/seo?
Intermediate & Advanced SEO | | nat88han0 -
Sitemap error
Hey Guys Everytime I run the tester through google webmaster tools - I keep getting an error that tells me "Your Sitemap appears to be an HTML page. Please use a supported sitemap format instead." An idea how to go about fixing this without changing the site around? https://www.zenory.co.nz/sitemap I have seen competitors sitemaps look similar to mine. Cheers
Intermediate & Advanced SEO | | edward-may0 -
Mobile SEO vs. normal SEO?
Hi everyone, I wanted to ask you abour your opinon on mobile SEO. Do we already have two different Indices, one for mobile, one for desktop? Except a few mobile listings I don't see a difference yet. If yes, do I need to do special mobile SEO for my site or is it enough to have e.g. a responsive webdesign which detects the device and shows a different page? Are there any other extra Mobile SEO measures that should be considered? I know of the Mobile Sitemap and directories but is there anything else? Best regards
Intermediate & Advanced SEO | | CrazySEO0 -
Link Juice Vs. Page Rank
What is better from an SEO point of view a Page with Page Rank of 5 with 0 clicks linking to your site or a page with a Page Rank of 3 with 1000 clicks linking back to your site? Is link juice important? do search engines count Link Juice?
Intermediate & Advanced SEO | | SEODinosaur0 -
Pros and cons of seperate sites vs. subdomains
First timer and new to SEO We are designing a website for a customer in south america that has 3 distinct divisions. We want to develop the site in the most SEO effective way possible. Each division will have its own keyword focus, its own associations and its own links. They will all link to each other from the main page company.com. we were thinking of creating 4 different seperate domains such as... www.company.com - basic high level company information with links to the other external sites below. www.company-contructionsoftware.com www.company-itservices.com www.company-graphicdesign.com so my questions are: 1- is it better in the long run to have domains that have the search terms in the url like specified above? We can optimize for the main site as well as the individual sites separately 2- would the result be the same using subdomains? for example, itservices.company.com 3- possibly hosting the 3 different sites in different locations? We want to make sure that we are building using the the best possible architecture for future optimization and internet marketing. What are the pros and cons? Thanks!!!!
Intermediate & Advanced SEO | | brantwadz0 -
Managing 404 errors
What is the best way to manage 404 errors for pages that are no longer on the server. For example, client deletes old site from server and replaces it with new site. Webmaster tools is reporting 100 + 404 errors form the old site. I've blocked the 404 pages with robot.text. Requested removal in google webmaster tools. And created a custom 404 page - http://www.tvsphoto.com/missingurlexample Is there anything else I can do?
Intermediate & Advanced SEO | | SEOProPhoto0