Why does Linkscap API request hang while extracting data ?
-
Hi,
I am using LinkScape API to get follow and nofollow links .
I use cron to get data for each url of sitemap.xml.
However while cron is running, the extraction of data hangs on some pages which i later need to delete manually for re starting the execution.
Do anyone have any idea why this is happening ? How can i ignore such pages ?
-
Hi...
Thank you so much for your reply..
I was implementing the changeswhich may work.. but they didn't.
I recently came to know about updates to seomoz api which are like,
- SEOmoz Free API: 1 request for every 10 seconds
- Free Extended and PRO Members: 1 request every 5 seconds
- SEOmoz Site Intelligence API: 1 request every 2 seconds
I think this will help me a lot .. thank you ..
-
Hey Ravi,
Sorry for the delayed response - I wanted to follow up with the engineers to see if they had any suggestions for you.
They agreed the Limit parameter set to 1,000 might be too large to process. Have you tried adjusting that to 300 or even 500? Do you see better success at a lower limit?
Our system will timeout at about 60 seconds so I'm not sure if the hanging is on our end. If dropping the limit size doesn't help, you might want to think about ending the request after about a minute. Sometimes requests that are too long wil timeout, but work fine on a retry as some data will be cached from the previous request.
I hope this information is helpful, but let me know if you're still experiencing issues!
Thanks,
Carin -
Some pages are the pages which are moved or not found. I am trying to ignore such pages by getting http response code. But this process takes large amount of time. Almost 10 minutes for a single url of sitemap.xml.
The url of call is like : (php)
http://lsapi.seomoz.com/linkscape/links/URL HERE?SourceCols=4&TargetCols=4&Scope=page_to_page&Sort=page_authority&Limit=1000&Filter=follow&AccessID=" . $accessID . "&Expires=" . $expires . "&Signature=" . $urlSafeSignature;
Thanks .
-
Hey! This is an issue I haven't heard of before - would you be able to provide anymore information like an example query to the API and some of the pages you are seeing hang?
Thanks!
Carin
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Hi there- Does anyone know if you can pass Adobe SC analytic data into MOZ? Rather than using GA?
Hi There, Is it possible to pass Omniture data into MOZ rather than using Google Analytics? Thanks!
Moz Pro | | GrandCircleCorp1 -
Why is OSE showing no data for this URL?
Hi all, Does anyone have any ideas as to why OSE might not have any data for this URL: http://www.ccisolutions.com/StoreFront/product/shure-slx24-sm58-wireless-microphone-system-j3 It is not a new page at all. It's been on the site for years. Is OSE being quirky? Or is there an underlying problem with this page? Thanks in advance for any light you can shed on this, Dana
Moz Pro | | danatanseo0 -
Mozscape API Problem With Credentials
Yello everyone 🙂 Yesterday I generated Access ID and Secret Key to try the API, but it didn't work. It's said that it might need 5 minutes, so I gave it something like 8 hours but it still didn't work afterwards. I used the PHP sample and I checked it with the Sample Expires value and it produces the same Signature parameter as in the Sample Valid API Signature, so the PHP code sample and the Sample Valid API Signature are in sync. In case you wonder - yes I changed the PHP sample by adding the valid strings for $accessID and $secretKey - I'm a long time programmer and I know what I'm doing with it. I tried also the example URL from Sample Valid API Signature couple of times, refreshing each time to get new Expire parameter, but it's not working too. Both the PHP sample and the Sample Valid API Signature are giving me this: **{ "status" : "401", "error_message" : "Your authentication failed. Check your authentication details and try again. For more information on signed authentication, see: http://apiwiki.seomoz.org/w/page/29574176/SignedAuthentication" }** I am new here and if there is another place to look for support please just point it out and excuse me for wasting your time - I just couldn't see it and I really tried. Thank you for your time to read this! Calvin Your Access ID:
Moz Pro | | Calvin50 -
Linkscape API having bugs
Hi, We are using the SEOMOZ Linkscape API (url-metrics and links) but the the API is not working well. We are sometimes (without any proveable reason) getting an http error with code 401. Like I said earlier it happens sometimes really often and sometimes just once. What could be the reason for this? We have an account with the following login seo@traffic-builders.com. Thanks in advance!
Moz Pro | | W_TrafficBuildersNL0 -
Difference between Seomoz Competitive Domain Analysis and OSE link data?
Any reason these numbers are so much different? SeoMoz Competitive Domain Analysis:
Moz Pro | | fibers
Followed Linking Root Romains: 288
Total Linking Root Domains: 338 Open Site Explorer
Linking ROot Romains: 1270 -
Do Google's recent changes effect the data SEOmoz delivers
Since Google made privacy changes and certain keyword tools such as MS have had to make drastic changes to continuing to be usefull, has SEOMoz encountered any problems and is your keyword data as reliable and accurate as before the Google change?
Moz Pro | | penandzeke0 -
Help with SEOmoz API
Hi guys, I'm trying to make API requests from my webserver via PHP. I'd like to retrieve data from the SEOmoz URL Metrics API. Unfortunately I always get the error response "unauthorized" even when I copy and paste the Sample Valid API Signature generated by your system into the browser. Is Signed Authentication not longer supported? I even tried the sample PHP Code SignedAuth.php but there's the same problem, too. If signed authentication is not longer available, do you have a code example for the basic http authorization? Thanks, Brandon
Moz Pro | | thegreatpursuit1 -
Historical Linkscape/OSE data available?
Hey Mozzerati, I'm curious if there's a way to expose and analyze historical data from each previous Linkscape/OpenSiteExplorer (OSE) update. Essentially, I'm looking for something similar to MajesticSEO's Backlink History tool that can show you both daily links over a short time as well as cumulative links over a long period. I think the utility of such a tool is to see which competitors have gained many links over a short period, signalling that they're engaging in some form of link-building/-buying/-baiting activity. Is there any way to yield this data (other than to record it manually after each Linkscape/OSE update) from SEOmoz PRO tools?
Moz Pro | | jcolman0