Tool to scrape data from Homedepot,ebay,amazon.
-
Does anybody know about a tool that you can use to aggregate data about the best seller products in categories for major retailers in USA? I did find a couple not so good tools for amazon and even ebay but retailers like walmart and homedepot are left out.
-
Hey Hardik,
Make sure to read the guidelines of these websites before start scraping to avoid any kind of legal actions. As far as the tools are concerned, you can try out these:
You can also scrap the sites with some PHP scripts, get the word of a developer for this.
Thanks,
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blocking Competitive Analysis Tools in robots.txt.... Worth it?
I've been considering blocking third party crawlers for a while – specifically those crawling my website for the sake of competitive analysis, such as SEMrush and Ahrefs. I'm familiar with how to do so, but when researching the question I found practically no one asking the same question. The guides I've found on what to put in your robots.txt make no mention of whether to block competitive analysis crawlers. Which makes me wonder whether this is a good idea after all. My chief concern here is rival sites going after the same search terms we target – one of our competitors in particular has an uncanny way of going after the same searches we are. I know blocking crawlers won't prevent competitors from watching our content, but it will make it slightly harder for them. Is there any major drawback I'm missing? Any big reason not to go ahead and block SEO analysis crawlers?
Competitive Research | | davidwaring0 -
Whats the Best Tool for Bulk SERPS Checking?
To get round the 'not provided' issue I've just generated a list of the 5000+ keywords that people have used to visit my site over the last 7+ years. I want to do a one off SERPS check for all these keywords and export into excel where I'll tie it up with lots of analytics and moz based data I was going to use the queries report on analytics but my data only goes back as far as May this year, so I'll use that if I have to (and probably will anyway for the impressions and CTR) but I'd prefer to cover everything so I can see any opportunities in my very long tail
Competitive Research | | Zippy-Bungle0 -
Which analytics tools do you use?
If you are interested in web analytics, could you tell me, which tools (software) do you use? No just Google Analytics, but also some other tools (e.x: for heatmaps, facebook, internal statistics, ... etc) I´m interested also in testing (A/B, ..) - so, also these tools you can mention thanks 🙂
Competitive Research | | mysho0 -
Keyword Research - tools
Hello all, I would like to find better synonyms for my keywords, and dig deeper to bid / place strategy into place for them. I am currently using the adwords too but it only gives me closely related keyword ideas. Is there something "free" which can give me a better co-relation data to work with? Thanks Aditya
Competitive Research | | shanky10 -
How can I obtain analytics and social data for a site that I'm not authorized on?
I'd like to get traffic information and facebook /twitter stats for a company. Don't know their ua, logins or have access to any of their pages. Where can I find this information? Any help would be greatly appreciated!
Competitive Research | | brandonschultz0 -
Link Analysis Tool
Does anyone have/use any really good link analysis tools? I have been using SEOmoz open site explorer but don't find it that indepth or find that many links. I don't mind paying once the link analysis tool is good and I can export links to excell. I was thinking of buying this software http://www.link-assistant.com/features-and-editions.html Cheers,
Competitive Research | | Socialdude0 -
Amazon vs. eBay
I'm doing an analysis to understand why Amazon outranks eBay sometimes. They are both big brands with alot of trust so just want to confirm my thinking and maybe gain some new insight. Amazon has more pages indexed (in Google), more internal links (pointing to homepage), and more images indexed in Google Image Search (alot more!), and of course a higher page rank.. So, question I would like to run by everyone, is are the stats basically what is responsible for Amazon's SEO success as compared to eBay? Or, is there something else I'm missing? PR: eBay 7, Amazon 9 Pages Indexed: eBay 106M, Amazon 875M Internal Links: eBay 62, Amazon 261 Google Images: eBay 150M, Amazon 4.3B
Competitive Research | | sofia120 -
Are there any tools to extract keywords and long tail keywords from a site and report keyword density by URL?
I need a tool that does the following: Find exact matches for keywords in content of sites and report keyword density by URL. Then identify the value generated by a particular keyword.
Competitive Research | | MotionPoint0