Why does Linkscap API request hang while extracting data ?
-
Hi,
I am using LinkScape API to get follow and nofollow links .
I use cron to get data for each url of sitemap.xml.
However while cron is running, the extraction of data hangs on some pages which i later need to delete manually for re starting the execution.
Do anyone have any idea why this is happening ? How can i ignore such pages ?
-
Hi...
Thank you so much for your reply..
I was implementing the changeswhich may work.. but they didn't.
I recently came to know about updates to seomoz api which are like,
- SEOmoz Free API: 1 request for every 10 seconds
- Free Extended and PRO Members: 1 request every 5 seconds
- SEOmoz Site Intelligence API: 1 request every 2 seconds
I think this will help me a lot .. thank you ..
-
Hey Ravi,
Sorry for the delayed response - I wanted to follow up with the engineers to see if they had any suggestions for you.
They agreed the Limit parameter set to 1,000 might be too large to process. Have you tried adjusting that to 300 or even 500? Do you see better success at a lower limit?
Our system will timeout at about 60 seconds so I'm not sure if the hanging is on our end. If dropping the limit size doesn't help, you might want to think about ending the request after about a minute. Sometimes requests that are too long wil timeout, but work fine on a retry as some data will be cached from the previous request.
I hope this information is helpful, but let me know if you're still experiencing issues!
Thanks,
Carin -
Some pages are the pages which are moved or not found. I am trying to ignore such pages by getting http response code. But this process takes large amount of time. Almost 10 minutes for a single url of sitemap.xml.
The url of call is like : (php)
http://lsapi.seomoz.com/linkscape/links/URL HERE?SourceCols=4&TargetCols=4&Scope=page_to_page&Sort=page_authority&Limit=1000&Filter=follow&AccessID=" . $accessID . "&Expires=" . $expires . "&Signature=" . $urlSafeSignature;
Thanks .
-
Hey! This is an issue I haven't heard of before - would you be able to provide anymore information like an example query to the API and some of the pages you are seeing hang?
Thanks!
Carin
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why is my campaign showing old data?
My campaign is stuck in a time-warp. It seems to think it's still May. Why is this? Can anyone help please.
Moz Pro | | rhiannondavies0 -
Is there any way to get historical API data?
I'm looking for a way of requesting domain authority and some other stats via the API for several previous months. I noticed on here: http://apiwiki.seomoz.org/what-is-the-mozscape-api
Moz Pro | | ReallyEasyCart
It says "SEOmoz PRO members now have access to historical API linking data - read about this great new feature on our blog!" but i could not find this blog post anywhere and maybe I'm misreading this line anyway.0 -
4XX (Client Error) Report - Referrer URL Feature Request
Why not allow me to click on the individual 404 errors in the 4XX (Client Error) report and allow me to actually see the where the broken links are coming from (as a hyperlinked url) so I can locate/click and fix them? Providing the referring url w/hyperlink will stop me from having to jump between the report and searching in site explorer, or downloading the complete error report and sorting.
Moz Pro | | WaterGuy0 -
Using api to find likes, tweets and shares
Hi all, I have a question regarding using the API to get data on a list of urls and not one by one. I am not a developer so I might not grasp the API so well. Basically I have a list of urls, what I need from each is the following information: <colgroup><col width="98"><col width="89"><col width="92"><col width="111"><col width="99"><col width="50"><col width="64"></colgroup>
Moz Pro | | rightmove
| Page authority | linking root domains | total links | Facebook Shares | Facebook likes | tweets | Google+1's | I found a google doc that gives me SOME of the data but not all (also it might be old as it uses the linkscape call (I dont know if thats changed)) Any idea how I can tune my googledoc spreadsheet to include the additional metrics? Thanks 🙂0 -
Mozcape API Batching URLs LIMIT
Guys, there's an example to batching URLs using PHP: http://apiwiki.seomoz.org/php Which is the maximum number of URLs I can add to that batch?
Moz Pro | | Srvwiz0 -
Tool Request - What keywords does a site rank for?
Hi folks, Something I've never had to do before so I'm not sure which tool to use, but is there a way to determine the keywords that a website currently ranks for? Hope someone can assist 🙂
Moz Pro | | ChristopherM1 -
Two PR 5 websites, but little to no link data in OSE. How??
As the title states - We've recently developed two sites for clients - within the last 4 months or so. With the Google PR update, both sites are sitting as PR 5 sites. I've tried to have a look in the OSE for the backlink profile of both websites, but I see nothing. Even Majestic SEO's fresh index doesn't provide much info. The DA of each site is 11-16. I would really love to see what's generating the link juice to these sites. Any ideas? The two sites are: https://bfore.co.za
Moz Pro | | Mark.RedGiant
http://ictjournalafrica.net0 -
Seomoz keyword difficulty api
Is there a way to get this from an api or a better method than pasting 5 keywords at a time into the keyword difficulty tool to get these numbers?
Moz Pro | | insitegoogle0