How I can check if Google and other search engines will properly cache a page (a dynamic one)?
-
My site is currently disallowing search engine bots with the help of robots.txt. These dynamic pages can be crawled using Screamingfrog since they are linked to a static category page which is also linked to the homepage.
Thanks in advance!
-
Great idea using Screaming Frog first then :-
Then use Google Web Master Tools > Crawl > Fetch as Google to see what Google sees
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
PDFs With No Index Contribute To Page Ranks?
I have a question I'm hoping you can help me with. If I upload a PDF and add a no index under the meta robots index so that the PDF doesn't appear in search results when I send people the link to this PDF, does it still contribute to my site traffic/ranking etc? Basically we are deciding whether to put some PDFs with pricing options etc onto our website or on a google drive. We will be sending the links to potential clients. If visitors clicking on the link would still help with increasing traffic and increasing our google rank (without that PDF showing in results) we thought this might be the best solution.
Algorithm Updates | | whiterabbitnz0 -
Which is the best way - to have all FAQ pages at one place, or splitted in different sections of the website?
Hi all, We have a lot of FAQ sections on our website, splitted in different places, depending on products, technologies, etc. If we want to optimize our content for Google's Featured Snippets, Voice Search and etc. - what is the best option: to combine them all in one FAQ section? or it doesn't matter for Google that this type of content is not in one place? Thank you!
Algorithm Updates | | lgrozeva0 -
Google sidebar advertising dropped
Has anyone noticed how the google sidebar advertising has completely disappeared? They only display top 4 adwords and then remaining on the bottom of each search page. I can't find any info on it or when it actually happened?
Algorithm Updates | | Purplesars110 -
Google update January 2015
Hello, In January 2015, google changed its European Algorithm. The change decreased the ranking of some of our keywords but not all. See article for more evidence in google changing its algorithm. https://www.seroundtable.com/google-update-maybe-19760.html The biggest change was the keyword phrase ‘Wholesale Silver Jewellery’ which we ranked 1 in SERP, but now we’re nowhere to be seen. However, the change didn’t affect our keyword phrase ‘Wholesale Jewellery Silver’, ’Wholesale Silver’ and ‘Wholesale Jewellery. We’ve been through our data and see that all of our ’Silver Jewellery’ keyword phrases are no longer showing in the SERP. Further research has shown that our competitors were also dropped down the rankings for the same keyword phrase. Our question is: Why has this update affected certain keyword phrases, such as ‘silver jewellery’ but not ‘jewellery silver’ and how should we over come this? Additional Information
Algorithm Updates | | SilverStar1
If you type in our company name ‘Mainly Silver’ or ‘mainlysilver’ were still showing in SERP, however if you type ‘mainlysilver jewellery’ we’re no where to be found. We’ve even checked ‘site:mainlysilver.co.uk silver jewellery’ in google search and it returns with ‘no results found’. If you switch the keyword phrase, all our web pages are showing up Our website is - www.mainlysilver.co.uk0 -
If Google Trends Doubles?
If google shows a search trend doubling in a time frame, does that mean the amount of searches doubled? As in: 2006 was ranked at a 50 on trends and the 100 is 2013 and in 2013 10,000 searches were made, does that mean around 5,000 searches were made in 2006?
Algorithm Updates | | JoshBowers20120 -
How Do I Optimize with Google's Video Search?
Hi everyone, I am looking here https://developers.google.com/webmasters/videosearch/schema and I don't fully understand. Could someone please explain, step by step, what I have to do to optimize for Google video search? I.e. Step 1 do this Step 2 do this. I don't fully understand Thank you!
Algorithm Updates | | jhinchcliffe0 -
Should social widgets be the kind that shares/likes a page, or the kind that adds followers to a brand social page?
I'm wondering if the social widgets on my blog should create a share/like referencing the page or should the social widget create a follower to my brands page on a particular social network? Any ideas?
Algorithm Updates | | salesduke0 -
Trying to figure out why one of my popular pages was de-indexed from Google.
I wanted to share this with everyone for two reasons. 1. To try to figure out why this happened, and 2 Let everyone be aware of this so you can check some of your pages if needed. Someone on Facebook asked me a question that I knew I had answered in this post. I couldn't remember what the url was, so I googled some of the terms I knew was in the page, and the page didn't show up. I did some more searches and found out that the entire page was missing from Google. This page has a good number of shares, comments, Facebook likes, etc (ie: social signals) and there is certainly no black / gray hat techniques being used on my site. This page received a decent amount of organic traffic as well. I'm not sure when the page was de-indexed, and wouldn't have even known if I had't tried to search for it via google; which makes me concerned that perhaps other pages are being de-indexed. It also concerns me that I have done something wrong (without knowing) and perhaps other pages on my site are going to be penalized as well. Does anyone have any idea why this page would be de-indexed? It sure seems like all the signals are there to show Google this page is unique and valuable. Interested to hear some of your thoughts on this. Thanks
Algorithm Updates | | NoahsDad0