Is there a tool that will find a string from the source code from a list of URLs?
-
I need a tool that will run through a long list of URLs (from multiple domains), look for a specific string in the source code and then produce a CSV showing in which URLs the the string was found.
This is for legitimate research, not for any nefarious purposes
Any ideas of such a tool already exists?
-
Cheers Dirk
Didn't know Screaming Frog could do that. Works perfectly!
Screaming Frog is just the gift that keeps on giving
-
+1 for Screaming Frog
-Andy
-
If you have the list of url's you want to check in csv you could use Screaming Frog: put the string in a custom filter & crawl the urls based on the list. Applying the filter will only include the url's that contain the string in the source code.
rgds,
Dirk
-
H Danny,
I have never used it but ScrapeBox has a page scanner that sounds like it would work.
http://www.scrapebox.com/page-scanner
Hope that helps,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Search Behavior | | Alyaauditors0 -
Dark Traffic & Long URLs - Clarification
Hi everyone, I've been reading the 2017 report by Groupon and the 2017 article by Neil Patel r.e. dark traffic. Both of these articles work on the assumption that most long URLs are not direct traffic because people wouldn't type a long URL into their browser. However, what happens to me personally all the time is that I start typing a URL into the browser, and the browser brings up a list of pages I've visited recently, and I click on some super long URL that I didn't bookmark but have visited in the past. That is legitimate direct traffic, but it's a long URL. I'm just wondering if there's something flawed in my reasoning or in the reasoning of Patel and Groupon. Maybe most people aren't relying on browsers like I am, or maybe things have changed a lot in the past 3 years. What do you think? And are there any more recent resources/articles that you would recommend r.e. trying to parse out dark traffic? https://neilpatel.com/blog/dark-traffic-stealing-data/ Thanks!
Search Behavior | | LivDetrick0 -
Free Tool that allows you to compare traffic for multiple websites
I'm banging my head on this one. In the past I was able to use Compete.com, Quancast, Google Trends, and Alexa, but now all these sites either required you to have Pro membership (pay) or they discontinue it like Google Trends for website. I need to do this comparison for one of my client... their traffic versus 4 of their competitors. Any suggestions would be greatly appreciated. Have a blessed Day, Benny
Search Behavior | | ACann1 -
Canonical url for eshop, to do or not to do?
Hello everyone, I'm having a headache right now in designing a url base for a eshop. I would be thankful for any suggestions. Just to be clear about my problem, I'll be using this product example:
Search Behavior | | donatasBart
Product name: Product
Categories: Sale, Women
Brand: Superbrand Basicly every name of product, category or brand will resolve as url, if I enter url: /product it will open Product page /superbrand it will open brand page /superbrand/product will open product page from superbrand page /superbrand/sale/product would open product page selected from superbrand, then category sales /superbrand/woman/product would open product page selected from superbrand, then category woman So I will have many variations how to reach the product page, and of course i should set canonical url for it. I could set it just to /product , but then I don't know if I won't loose in terms of seo for other more detailed urls. Will google still index my other urls for product if i will state the canonical url in each product page? I know, maybe it would be the best solution to create a link like this: /superbrand_sale_product , which I can, but however it will be a duplicate content issue, since there will me many url pointing to the same product, and the only difference between them will be category, brand or whatever else... Thanks for all your ideas!0 -
Google Analytics Segments - Can't find location
Hi all, I am trying to set up a Google Analytics segment with the location as 'Kurdistan'. I have tried all location groupings (city, region etc) and am unable to locate it. Anyone else not able to locate it? Or does anyone know why I can't? Thanks,
Search Behavior | | Davinia22
Davinia0 -
Two sites with different URLs
I help organize an ecommerce site for a company that is named after the state that the company was founded in (ex: Florida Pipes). Our programmer is thinking about creating a duplicate site that would have a name that was more location agnostic so people shopping on the site would not think that they may be ordering from far away hence incurring extra shipping charges. He said that the site would only have a different URLs, name and homepage but would link to all of the same stuff that is on the site that is up now. He said that there would be no way to tell (possibly for the layperson) that the two sites were related. Is this a good practice? Would we be penalized in search results for having two URLs linking to the same content? (We are a 30 year old company that ranks very high for our main keyword) Thank you for your input!
Search Behavior | | Winoman0 -
Where can I find research into consumer behavior in URL input?
I have a hypothesis that the % of users that type URLs is decreasing. Instead I think users will be arriving at sites by clicking on links in emails, search and social. Where can I find data / research to back me up?
Search Behavior | | TomCritchlow0 -
Can I use Google Analytics to find out actual times of visits during the day??
Hi, I'm a newbie at all this - I hope someone can help me. We're thinking of running time-specific offers to try and convert as many of our customer site visits as possible e.g. 15% discount if you call between, say, 2 and 5pm. It would be really helpful to me to find out what times of day people are visiting our site. I can't seem to find a way to do this on Google Analytics. Can anyone help? Thanks so much Sue
Search Behavior | | 3Amigos0