Is there a tool that will find a string from the source code from a list of URLs?
-
I need a tool that will run through a long list of URLs (from multiple domains), look for a specific string in the source code and then produce a CSV showing in which URLs the the string was found.
This is for legitimate research, not for any nefarious purposes
Any ideas of such a tool already exists?
-
Cheers Dirk
Didn't know Screaming Frog could do that. Works perfectly!
Screaming Frog is just the gift that keeps on giving
-
+1 for Screaming Frog
-Andy
-
If you have the list of url's you want to check in csv you could use Screaming Frog: put the string in a custom filter & crawl the urls based on the list. Applying the filter will only include the url's that contain the string in the source code.
rgds,
Dirk
-
H Danny,
I have never used it but ScrapeBox has a page scanner that sounds like it would work.
http://www.scrapebox.com/page-scanner
Hope that helps,
Don
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Dark Traffic & Long URLs - Clarification
Hi everyone, I've been reading the 2017 report by Groupon and the 2017 article by Neil Patel r.e. dark traffic. Both of these articles work on the assumption that most long URLs are not direct traffic because people wouldn't type a long URL into their browser. However, what happens to me personally all the time is that I start typing a URL into the browser, and the browser brings up a list of pages I've visited recently, and I click on some super long URL that I didn't bookmark but have visited in the past. That is legitimate direct traffic, but it's a long URL. I'm just wondering if there's something flawed in my reasoning or in the reasoning of Patel and Groupon. Maybe most people aren't relying on browsers like I am, or maybe things have changed a lot in the past 3 years. What do you think? And are there any more recent resources/articles that you would recommend r.e. trying to parse out dark traffic? https://neilpatel.com/blog/dark-traffic-stealing-data/ Thanks!
Search Behavior | | LivDetrick0 -
Long list or paginated pages
Hi peeps, I am just interested in this from a usability POV and to see what you would prefer to see when you are met with a page that has multiple options. Lets say that the page looks like a list of services, each clearly marked out in its own segment, but there are 50-60 options that match your requirements. Do you like to keep scrolling, or would you prefer to take what is there and then move on if you feel you want to dig deeper? Would you like to see a long list, of have the options loaded in as you get to them? -Andy
Search Behavior | | Andy.Drinkwater2 -
Google Analytics Segments - Can't find location
Hi all, I am trying to set up a Google Analytics segment with the location as 'Kurdistan'. I have tried all location groupings (city, region etc) and am unable to locate it. Anyone else not able to locate it? Or does anyone know why I can't? Thanks,
Search Behavior | | Davinia22
Davinia0 -
How come this one google places listing is the only one to show up google maps?
Hi there, I found a really weird thing about google places. I'm working on a google places listing optimization for a locksmith company in Houston, TX. When I was searching google maps for "locksmith houston" only one listing came up. However, when searching for "locksmith near houston" 880 results came up. This changes from time to time, but most of the time this one competitor is the only listing that shows up which is really really weird. Anybody has an idea what this competitor did to get rid of the other 879 results and show up alone on google maps??
Search Behavior | | activechase1 -
All pages were returning 404 for an hour. Will it impact the SERPS?
Hi, Due to a bug in my website system, all the pages were returning an 404 default page for a period of 1 hour. Can this event impact the SERPs of this site? (the site is heavily visited, more than 500k users coming from google every day, so I assume google crawls my pages every moment)
Search Behavior | | lucasms0 -
How come some local 7 pack listings link to site and some link to the G+ page?
Does anyone know how to fix this issue? Even though a site profile has had the website added to it Google continues to link the main "title tag" link to the G+ page and not the actual website domain. Thanks for any info in advance! https://www.google.com/#sclient=psy-ab&q=dog+sitting+in+rockaway&oq=dog+sitting+in+rockaway&gs_l=hp.3..0i22i30l4.14871.16189.1.16397.8.8.0.0.0.0.296.2042.2-7.7.0...0.0...1c.1.15.psy-ab.Y1db0jo77V0&pbx=1&bav=on.2,or.r_cp.r_qf.&bvm=bv.47244034,d.bmk&fp=722b460c2153b7be&biw=1920&bih=910
Search Behavior | | irvingw0 -
Would you instinctively mistrust a company that has the top 5 or more search listings?
I have seen a few "lucky"(?) companies dominate spots 1-5 of search results. When I see that, I generally go to #6, 7, or even 10 before clicking. My gut reaction is that the company with 1-5 has manipulated content just to pull me in - much like the guys on the streets of NYC or Vegas shoving handbills at you. Is there any evidence/research/poll about the consumer/user reaction when this occurs?
Search Behavior | | AMSVansSEOTeam0 -
New EU Laws governing cookies; will Google Analytics still be usable after May 25th?
Hi, first time I've posted a question, New EU Laws governing cookies; will Google Analytics still be usable after May 25th? - apologies in advance if its already been covered, but I couldn't find any answers when I searched - google search showed someone else ask the question already, but no straight answers were given:- From May 25th the Privacy and Electronic Communications Directive will come in to force which prohibits the use of cookies without informed, prior consent from web users. I've been trying to research to see whether or not this will affect Google Analytics.The Directive seems to be designed to prevent behavioural tracking, rather than web stats, but after reading the directive (with no law experience) I'm fairly confused by what will be prohibited. If anyone has any thoughts on the matter, I'd be very grateful! 🙂
Search Behavior | | bendyman1