Why does Linkscap API request hang while extracting data ?
-
Hi,
I am using LinkScape API to get follow and nofollow links .
I use cron to get data for each url of sitemap.xml.
However while cron is running, the extraction of data hangs on some pages which i later need to delete manually for re starting the execution.
Do anyone have any idea why this is happening ? How can i ignore such pages ?
-
Hi...
Thank you so much for your reply..
I was implementing the changeswhich may work.. but they didn't.
I recently came to know about updates to seomoz api which are like,
- SEOmoz Free API: 1 request for every 10 seconds
- Free Extended and PRO Members: 1 request every 5 seconds
- SEOmoz Site Intelligence API: 1 request every 2 seconds
I think this will help me a lot .. thank you ..
-
Hey Ravi,
Sorry for the delayed response - I wanted to follow up with the engineers to see if they had any suggestions for you.
They agreed the Limit parameter set to 1,000 might be too large to process. Have you tried adjusting that to 300 or even 500? Do you see better success at a lower limit?
Our system will timeout at about 60 seconds so I'm not sure if the hanging is on our end. If dropping the limit size doesn't help, you might want to think about ending the request after about a minute. Sometimes requests that are too long wil timeout, but work fine on a retry as some data will be cached from the previous request.
I hope this information is helpful, but let me know if you're still experiencing issues!
Thanks,
Carin -
Some pages are the pages which are moved or not found. I am trying to ignore such pages by getting http response code. But this process takes large amount of time. Almost 10 minutes for a single url of sitemap.xml.
The url of call is like : (php)
http://lsapi.seomoz.com/linkscape/links/URL HERE?SourceCols=4&TargetCols=4&Scope=page_to_page&Sort=page_authority&Limit=1000&Filter=follow&AccessID=" . $accessID . "&Expires=" . $expires . "&Signature=" . $urlSafeSignature;
Thanks .
-
Hey! This is an issue I haven't heard of before - would you be able to provide anymore information like an example query to the API and some of the pages you are seeing hang?
Thanks!
Carin
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
GOOGLE ANALYTIC SKEWED DATA BECAUSE OF GHOST REFERRAL SPAM ND CRAWL BOTS
Hi Guys, We are having some major problems with our Google Analytics and MOz account. Due to the large number of ghost/referral spam and crawler bots we have added some heavy filtering to GA. This seems to be working protecting the data from all these problems but also filtering out much needed data that is not coming through. In example, we used to get a hundred visitors a day at the least and now we are down to under ten. ANYBODY PLEASE HELP. HAVE READ THROUGH MANY ARTICLES WITH NO FIND TO PERMANENT SOLID SOLUTION (even willing to go with paid service instead of GA) Thank You so Much, S.M.
Moz Pro | | KristyKK0 -
No data in Moz
Hello, Since last tuesday there has been no data in Moz anymore. The error code for the homepage says: '608 : Page not decodable as specified Content-Encoding:' I checked this list http://moz.com/help/pro/why-can-t-rogerbot-crawl-my-site but it doesn't tell me more.
Moz Pro | | MarcelMoz
Hopefully anyone can help me. Thanks, Marcel0 -
Simply Report for new requests with Moz Pro Plus
Hi all I'd like to know how can I construct a brief report to send to my potential customers when they first write me asking for general informations and evaluation about their websites and certain keywords for which they want to have a great rank. I'd like to reply them with a short email, with a basic report attached, in which showing them some little details about their (and eventually their competitors) ranking and/or their website situation. It's just a brief professional introduction to our seo and web marketing services. Now I'm doing it manually or with other seo tools, but I have just bought a Moz Pro Plus annually version and I'd like to use Moz for this activity. For example, when I first insert a new campaign, I don't see ranking for days so I can't send rankinh report. Do you have any advice? Thanks.
Moz Pro | | Penny10 -
Linkscape API Sort calls
I'm using Linkscape API plugin from SEO Gadget. It's all fine but I can't find any documentation on other 'sort' calls. The only request that I knows that works is "domains_linking_page". Any idea where this information is? I was hoping for a list of all the available requests I can and more particularly I want to sort it by Internal Linking Domains.
Moz Pro | | iProspect-397560 -
Opensiteexplorer details in API
Is there a way to access opensiteexplorer result details via seomoz's API? Most interested in the social media results
Moz Pro | | fuzzlepop0 -
Do Google's recent changes effect the data SEOmoz delivers
Since Google made privacy changes and certain keyword tools such as MS have had to make drastic changes to continuing to be usefull, has SEOMoz encountered any problems and is your keyword data as reliable and accurate as before the Google change?
Moz Pro | | penandzeke0 -
Any SEO moz users notice a HUGE change in OSE (Open Site Explorer) link data numbers?
Hi All, I am having some serious concern with OSE data recently for numerous clients, one client I want to talk about today has the following data from OSE for the month of August 2011 compared with July 2011: Total links to the domain: (decrease of around 100,000+)
Moz Pro | | ColumbusAustralia
External Followed links: (decrease by around 5,000)
**Linking Root domains: (decrease of over 60) ** The crazy thing is that the domain authority has actually gone up by around 5 points for this client even though every thing has suddenly gone down? Also funny thing is we have been link building quite strong for this client over the last 12 months using only high quality sources from out niche. I am worried that their is serious issues with the data, I realise we saw some updates to OSE recently yet I am suprised it can be this drastic. Kind Regards. PSV1 -
Historical Linkscape/OSE data available?
Hey Mozzerati, I'm curious if there's a way to expose and analyze historical data from each previous Linkscape/OpenSiteExplorer (OSE) update. Essentially, I'm looking for something similar to MajesticSEO's Backlink History tool that can show you both daily links over a short time as well as cumulative links over a long period. I think the utility of such a tool is to see which competitors have gained many links over a short period, signalling that they're engaging in some form of link-building/-buying/-baiting activity. Is there any way to yield this data (other than to record it manually after each Linkscape/OSE update) from SEOmoz PRO tools?
Moz Pro | | jcolman0