Technical Question about tools available in market
-
Hi,
I am looking for a tool most probably web based tool like opensiteexplorer / majestic seo that gives me the list of URL
For example, on google we can do site:seomoz.org , and it's saying About 115,000 results.
I need to get list of those 115,000 URLS in any file whether it's csv or any other.
anybody care to share ?
-
SEOmoz use to have this option in the past days but recently when i checked its gone... but while research to answer this question i found this http://www.martinhurford.com/serp-downloader-bookmarklet.html
Check this out and see if it is powerful!
-
I agree that Screaming Frog is the best. http://www.screamingfrog.co.uk/seo-spider/
You can get a full list of URLs including data on the following:
- Errors – Client & server errors (No responses, 4XX, 5XX)
- Redirects – (3XX, permanent or temporary)
- External Links – All followed links and their subsequent status codes
- URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters
- Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content
- Page Title – Missing, duplicate, over 70 characters, same as h1, multiple
- Meta Description – Missing, duplicate, over 156 characters, multiple
- Meta Keywords – Mainly for reference as it’s only (barely) used by Yahoo.
- H1 – Missing, duplicate, over 70 characters, multiple
- H2 – Missing, duplicate, over 70 characters, multiple
- Meta Robots – Index, noindex, follow, nofollow, noarchive, nosnippet, noodp, noydir etc
- Meta Refresh – Including target page and time delay
- Canonical link element & canonical HTTP headers
- X-Robots-Tag
- File Size
- Page Depth Level
- Inlinks – All pages linking to a URI
- Outlinks – All pages a URI links out to
- Anchor Text – All link text. Alt text from images with links
- Follow & Nofollow – At link level (true/false)
- Images – All URIs with the image link & all images from a given page. Images over 100kb, missing alt text, alt text over 100 characters
Thanks
-
ScreamingFrog the best
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword research tools that provide specific suggestions re: Voice Search?
Hi, I'm wondering which are the best Keyword research tools that provide specific volumes and suggestions re: Voice Search - including on question type searches? Any suggestions would be brilliant - thanks in advance, Luke
Moz Pro | | McTaggart0 -
Anyone had an Extensive Look at Hubspot SEO Features and Tools ?
Mozz, Some co-workers are looking into some of the of tools that Hubspot offer as part of there marketing package, I understand it is part of a bigger picture for the hubspot software and moz is much more focused on technical seo etc, But i am just wondering if anyone had spent any extensive time using the hubspot software and has any feedback on the tools? Is there anything (Just the seo section) that moz cannot ? there are alot of really great moz tools i use that i haven't seen in the hubspot software, like the crawl test, the onpage grading doesn't look at as many aspects as moz, link information and opportunities looked limited compared to moz/majestic seo , no landing page tool like the one built into moz analytics campaigns and hubspot just generally seemed to provide less information ? Any advice or feedback would be grealy appreciated ? Thanks James
Moz Pro | | Antony_Towle0 -
Links being reported in Webmaster Tools
Hi Are the Total Links To Your Site, as reported in GWT, purely external inbound links ? Since these links are usually, as far as i can tell, much higher in number than any other link reporting tool and hence, i presume, more accurate, why don't services such as Moz etc include this in reporting ? I know its just a total number and link quality is whats important not quantity, but i would have thought interesting to show in reporting in conjunction with link quality info such as is already reported. Since most backlink reporting tools do show a total but always much much lower than that reported in gwt (i think) All Best Dan
Moz Pro | | Dan-Lawrence0 -
Mac Alternatives for Netpeak & SEO Tools For Excel?
Does anybody know of any mac alternatives for Netpeak & SEO tools for excel? I haven't been able to find any. I just need something to pull PA & DA quickly for a list of domains and URLs. Will I just have to create something custom with the Moz API?
Moz Pro | | kking41200 -
Does SEOmoz tool provide me the option to track rankings for other search engines like google.co.uk?
I need to track rankings on search engines across different geographies. Does your tool provide the option to track rankings for search engines other than the ones used in US
Moz Pro | | zycus0 -
Mozbar SERP Control Panel Help: Export Results Option Not Available
Hi everyone. For some strange reason, the "Export" option is no longer appearing in my SERP Control panel when trying to export results from the SERP Overlay. It worked fine before SEOMoz changed over to Moz, but now the option is no longer available. Is there something I can do to restore this feature?
Moz Pro | | bashseo2 -
Mozbar question
Hi, In the mozbar it has the following for this post: PA: 55 mR: 3.28 mT: 4.43 DA: 88 What does this data mean and how would you use it to spot a weakness in a competitor? Now the domain strength is very high 88, so I know you would have trouble attacking that if your own DA was 48. p.s this is just an example
Moz Pro | | activitysuper0 -
Where is the labs LDA topics tool? The articles mentioning it point to http://www.seomoz.org/labs/lda but that forwards me to the tools landing page.
I searched SEOMOZ for this but haven't yet found the answer. It seems that it's been removed. I'm sure it was announced somewhere that I missed
Moz Pro | | bluenote0