How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you check my Quran site and its technical issues?
Hi, Hope you are doing good, I saw many Quran websites working fine. I have a blog that has online Quran classes of Arabic and Tajweed related courses as well. Can you please check that if all is okay in terms of technical issues? Here is the website: https://learnquran.academy
SEO Learn Center | | ShirleyLemons0 -
Is The Moz Community Rankings broken?
Not as active as I would have liked recently but still visit and login, answering a question now and again, yet I can see my profile is still listed as unranked. until recently I was somewhere around 45-49 and have been for many years - the criteria appears to be what it has for the last ten years or so. I see people with lower moz points outranking members with far more points. I can even see one with 0 points now appearing in the top 50 so my question is - is the moz community rankings broken or have I missed something? I know once before I pointed it out and it had to be fixed...input from all welcome 🙂
SEO Learn Center | | Matt-Williamson2 -
My Wordpress Organic Blog traffic disappeared and Google is indexing Viagra and Online Med titles for some articles. How to fix that?
Hello, I'm worried that all my organic traffic has disappeared according to Analytics from past friday and now Google is showing results from my title tags in the last days as you can see here: http://goo.gl/QFSgy Is there any additional resources I can read apart from Google Clean Your site Guidelines here https://support.google.com/webmasters/answer/163634 or the Wordpress FAQ for hacked sites here? http://codex.wordpress.org/FAQ_My_site_was_hacked Very much appreciated all of your help! Regards.
SEO Learn Center | | viventuraSEO0 -
Site for my clients to log in and see their traffic, etc.
I have done a ton of research and I am struggling to find an easy to use, easy to understand site / tool that will allow my clients to log in and see basic information about their website traffic, rankings, referring sites, etc. in an ATTRACTIVE, EASY TO UNDERSTAND layout. Any suggestions would be greatly appreciated! Seomoz (my true favorite) Raven, webceo, and so many others are powerful tools - I don't need that, just looking for an attractive place to log in and view their stats, that's it. Thank you - have a great rest of the week! Matthew
SEO Learn Center | | Mrupp440 -
Google plus provides dofollow or nofollow backlinks?
I see my webmaster full of backlinks coming from sites like Google.com(plus) Twitter.com(tweets) Stumbleupon chime Scoop.it 1.Are these backlinks follow or nofollow? 2.Follow or nofollow backlinks surely do not pass PR effect but do the nofollow backlink helpful in rank or not?
SEO Learn Center | | csfarnsworth0 -
I missed the "Making Your Pitch" webinar
When will this be available in the previously recorded section? Thanks Sean
SEO Learn Center | | SeanTheWebGuy0 -
Multilingual site (rel="alternate" hreflang="x")
Hi there, We have a multilingual site with same content translated into different languages. Some are also in different countries with same language. The issue with our site is that international Google SERP shows our US site before their own country/language site. In order to resolve this issue, we implemented the following rel="alternate" hreflang="x" across all locales: After testing these out, our US site still shows up on search results in other countries (checked after 2 months). Are we missing something here? Our guess is that it's not working because we are missing canonical tags or meta language code (). Thanks in advance.
SEO Learn Center | | hjoeng-010 -
How do I get google to crawl white papers that displays a form for human visitors?
How do I get Google to crawl white papers that displays a form for human visitors? I have been looking into this and understand that I need to set the form up as a GET form which has been done. Google said they want you to "avoid" forms that require personal information but to what extent do they want you to do that? The form is used as a lead generator so we need to collect information such as name, company name, email, ect.The information we require currently is: Name, Company name, Email, Phone Number and Number of employees. Once a user puts in their information they have access to the rest of the content and they don't need to re-enter the information in so I assume once Google gets past this feature they can gain access to the rest of the content. I understand that I need to have a form that doesn't ask for personal information which is the dilemma. So what should we do to work around this? Is there a solution that will allow me to obtain some personal information while still allowing Google to crawl the pages? Thoughts and any feedback is much appreciated, TJ
SEO Learn Center | | SEO_com0