Why does Linkscap API request hang while extracting data ?
-
Hi,
I am using LinkScape API to get follow and nofollow links .
I use cron to get data for each url of sitemap.xml.
However while cron is running, the extraction of data hangs on some pages which i later need to delete manually for re starting the execution.
Do anyone have any idea why this is happening ? How can i ignore such pages ?
-
Hi...
Thank you so much for your reply..
I was implementing the changeswhich may work.. but they didn't.
I recently came to know about updates to seomoz api which are like,
- SEOmoz Free API: 1 request for every 10 seconds
- Free Extended and PRO Members: 1 request every 5 seconds
- SEOmoz Site Intelligence API: 1 request every 2 seconds
I think this will help me a lot .. thank you ..
-
Hey Ravi,
Sorry for the delayed response - I wanted to follow up with the engineers to see if they had any suggestions for you.
They agreed the Limit parameter set to 1,000 might be too large to process. Have you tried adjusting that to 300 or even 500? Do you see better success at a lower limit?
Our system will timeout at about 60 seconds so I'm not sure if the hanging is on our end. If dropping the limit size doesn't help, you might want to think about ending the request after about a minute. Sometimes requests that are too long wil timeout, but work fine on a retry as some data will be cached from the previous request.
I hope this information is helpful, but let me know if you're still experiencing issues!
Thanks,
Carin -
Some pages are the pages which are moved or not found. I am trying to ignore such pages by getting http response code. But this process takes large amount of time. Almost 10 minutes for a single url of sitemap.xml.
The url of call is like : (php)
http://lsapi.seomoz.com/linkscape/links/URL HERE?SourceCols=4&TargetCols=4&Scope=page_to_page&Sort=page_authority&Limit=1000&Filter=follow&AccessID=" . $accessID . "&Expires=" . $expires . "&Signature=" . $urlSafeSignature;
Thanks .
-
Hey! This is an issue I haven't heard of before - would you be able to provide anymore information like an example query to the API and some of the pages you are seeing hang?
Thanks!
Carin
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to track data from old site and new site with the same URL?
We are launching a new site within the next 48 hours. We have already purchased the 30 day trial and we will continue to use this tool once the new site is launched. Just looking for some tips and/or best practices so we can compare the old data vs. the new data moving forward....thank you in advance for your response(s). PB3
Moz Pro | | Issuer_Direct0 -
Latest Moz Data Update 2 Weeks Ago?
How often is the data supposed to be updated for our Moz campaigns? Mine have been updated on 07/15/2013 the last time. Isn't it supposed to be updated weekly?
Moz Pro | | sbrault740 -
I keep getting Authentication Failed on the API
I have the credentials in the URL correctly but it will continue to fail authentication. I will not post them obviously but is there a problem with the API currently? I tried creating new credentials Also I have used this before so I am sure it is not a problem with the credentials. I somehow managed to get Chrome to show the data. Firefox will not and the code i have written also return authentication failed. This is a bug on your end. Please fix it ASAP.
Moz Pro | | ColumK0 -
Historical data in rank report not matching summary?
I got a new rank report today. For a lot of keywords in Yahoo and Bing it is saying things like >49 etc. When I hover over it, it tells me that these are new keywords for me that I didn't rank for before. When I look at the historical graph for those specific engines though it just shows me going back at the same position historically. For example like position 17 going back many months without change. Can anyone tell me what is up with that?
Moz Pro | | edu-SEO0 -
You've recently updated your brand rules. We're fetching your new data, and we should have it ready for you within the hour.
Why do i always see this message when entering a certain campaign? "You've recently updated your brand rules. We're fetching your new data, and we should have it ready for you within the hour." I didnt change a thing since i started this campaign two-three weeks ago ...
Moz Pro | | alsvik0 -
Tool bar - Analyse page - Link data
Hi all, Need a little help to understand this link information, if you go to our toolbar it show 1.6 million links on 224 root domains. when you analyse the page using the Tool bar. the link data show the page as having over 3000 internal links but when you go page attributes it shows a more complementary 92 page links we have a menu to all our pages and I am wondering if this is being registered in its entirety
Moz Pro | | LocksOnline0 -
6 Months Data = Domain MozRank and MozTrust still 0.00
I have a domain with six months of data in my PRO account. The MozRank and MozTrust is still 0.00. Is this normal? If not, what on Earth am I doing wrong?!?
Moz Pro | | MikeHarmanos0 -
Traffic Data Lag
Today is 8/29/11. Why does my traffic data still show data from 8/8/11? It says last data update 8/15/11 but there is no 8/15 data showing. I should be able to view 8/22 by now. This is way behind. I'm a newbie so hook me up. What am I missing? It was updating every Monday but not anymore.
Moz Pro | | ranger001