Why does Linkscap API request hang while extracting data ?
-
Hi,
I am using LinkScape API to get follow and nofollow links .
I use cron to get data for each url of sitemap.xml.
However while cron is running, the extraction of data hangs on some pages which i later need to delete manually for re starting the execution.
Do anyone have any idea why this is happening ? How can i ignore such pages ?
-
Hi...
Thank you so much for your reply..
I was implementing the changeswhich may work.. but they didn't.
I recently came to know about updates to seomoz api which are like,
- SEOmoz Free API: 1 request for every 10 seconds
- Free Extended and PRO Members: 1 request every 5 seconds
- SEOmoz Site Intelligence API: 1 request every 2 seconds
I think this will help me a lot .. thank you ..
-
Hey Ravi,
Sorry for the delayed response - I wanted to follow up with the engineers to see if they had any suggestions for you.
They agreed the Limit parameter set to 1,000 might be too large to process. Have you tried adjusting that to 300 or even 500? Do you see better success at a lower limit?
Our system will timeout at about 60 seconds so I'm not sure if the hanging is on our end. If dropping the limit size doesn't help, you might want to think about ending the request after about a minute. Sometimes requests that are too long wil timeout, but work fine on a retry as some data will be cached from the previous request.
I hope this information is helpful, but let me know if you're still experiencing issues!
Thanks,
Carin -
Some pages are the pages which are moved or not found. I am trying to ignore such pages by getting http response code. But this process takes large amount of time. Almost 10 minutes for a single url of sitemap.xml.
The url of call is like : (php)
http://lsapi.seomoz.com/linkscape/links/URL HERE?SourceCols=4&TargetCols=4&Scope=page_to_page&Sort=page_authority&Limit=1000&Filter=follow&AccessID=" . $accessID . "&Expires=" . $expires . "&Signature=" . $urlSafeSignature;
Thanks .
-
Hey! This is an issue I haven't heard of before - would you be able to provide anymore information like an example query to the API and some of the pages you are seeing hang?
Thanks!
Carin
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
No data in Moz
Hello, Since last tuesday there has been no data in Moz anymore. The error code for the homepage says: '608 : Page not decodable as specified Content-Encoding:' I checked this list http://moz.com/help/pro/why-can-t-rogerbot-crawl-my-site but it doesn't tell me more.
Moz Pro | | MarcelMoz
Hopefully anyone can help me. Thanks, Marcel0 -
Latest Moz Data Update 2 Weeks Ago?
How often is the data supposed to be updated for our Moz campaigns? Mine have been updated on 07/15/2013 the last time. Isn't it supposed to be updated weekly?
Moz Pro | | sbrault740 -
Is there a way to get moz keywords analysis % through the api ?
I'm looking to integrate moz keywords analysis grade (in %) into my keyword research spreadshit as a column. Is there a way to get the % through the API ? Thanks
Moz Pro | | Sindicic_Alexis0 -
Website data updates
Hello All, I have downloaded some reports for "following" links from SEO Moz and no doubt the report is very comprehensive. However, I know some links listed in the reports does have rel="nofollow" tag attached to it but it is list still shown that they are following links. Can some please guide be to understand why this has happened. Is it possible that SEO Moz has old data of our site because these changes were recently done (2-3 weeks before)..? OR Have I misunderstood following as dofollow..? Any help would be highly appreciated. Thanks, moosa.
Moz Pro | | moosa0 -
How do I retrieve crawl and ranking data about a site from the past?
Hey. One of my main clients has asked to see the crawl data and rankings data for the past eight months. He wants to have tangible evidence of the effects of Penguin. I would like that info too. Is it possible to retrieve that information on a weekly crawl and ranking basis through SEO Moz and if so, how do you do it? I simply want to show a graph, timeline and brief explanation across several main keywords... Help me as you guys always do - You rock Best Ben
Moz Pro | | creativeguy0 -
Two PR 5 websites, but little to no link data in OSE. How??
As the title states - We've recently developed two sites for clients - within the last 4 months or so. With the Google PR update, both sites are sitting as PR 5 sites. I've tried to have a look in the OSE for the backlink profile of both websites, but I see nothing. Even Majestic SEO's fresh index doesn't provide much info. The DA of each site is 11-16. I would really love to see what's generating the link juice to these sites. Any ideas? The two sites are: https://bfore.co.za
Moz Pro | | Mark.RedGiant
http://ictjournalafrica.net0 -
Conflict in reported link data
I have a competitor in a campaign - the campaign report shows 181 linked domains BUT - the site explorer report shows only 15 linked domains. Which is correct? And if the site explorer is correct - how do we fix the campaign report? [URL]]([URL=http://imgur.com/m9xFv][IMG]http://i.imgur.com/m9xFv.jpg[/IMG][/URL]) m9xFv open-site-explorer open-site-explorer competitive-domain-analysis-humphreys-assoc.com-seomoz-pro
Moz Pro | | robertdonnell0