Coming Over From Raven Tools? Welcome to AuthorityLabs. We’re Here to Help.

Today, Raven Tools announced that they are doing away with SERP tracking data, and they have directed a lot of potential new users to us. We’re happy to be able to continue to provide the highest quality data to anyone who needs it.

We are currently working on a way to make moving your SERP tracking from Raven Tools to AuthorityLabs as seamless as possible. We know how important it is to save time when using tools and will be doing what we can to help.

Many of you are also looking for specific features that existed in Raven’s tools. We realize that it is important to have a seamless transition from one tool to another. Some of the feature differences between AuthorityLabs and RavenTools are in our product plan but just haven’t made it into our interface yet.

We’re looking at all of the requests from our current and new users and plan to be very transparent about upcoming product plans for the new year. Please feel free to send us any and all ideas, feedback, and feature requests and we will review them all.

Bear with us for a moment as we ramp up our feature set and we’ll be sure to get you what you need as soon as we can.

In the meantime, all of your SERP data will be collected ¬†from the time you sign up and start tracking keywords, and it is the same as the data you’re used to seeing from Raven, and welcome!

New Documentation, Courtesy of DocsWiki

We’ve been working nonstop to create the best SERP Tracking interface available. One of the most popular requests we have is for documentation on how to use the interface. We could do the same old boring knowledge base but decided that wasn’t acceptable. People need to understand the page they’re looking at while they are on that page. This led to the development of DocsWiki.

What is DocsWiki?

In a sentence: Help Docs that Don’t Suck. Don’t you hate it when you’re trying to find info on how to use something and there’s no way to be sure the documentation you find actually applies to what you’re using? Wouldn’t it be great to have docs, FAQs, and comments on what you’re using all in one place? That’s what DocsWiki does.

Integration into AuthorityLabs

Over the next couple weeks, we will be incorporating DocsWiki into all of the AuthorityLabs interface. If you’ve been wondering how to use certain features or didn’t know some features exist, the new docs should answer your questions. If not, feel free to let us know what you need and we will make sure it’s documented for everyone.

If you’d like to inquire about integrating DocsWiki into your own app, head on over to DocsWiki and let us know.

AuthorityLabs – August 2012 Status Update

We’ve been working hard here at AuthorityLabs for the past month or so to get people migrated and up to speed on our new interface. So far, everything is going smooth but we wanted to update everyone on where things stand.

Account Migrations

We’re about 1/3 of the way through migrating accounts into the new interface. It has been a little slower process than we would like due to the volume of keywords and domains that need to be transferred but we’re expecting the speed to pick up in the next week as we roll out some new importing features for the new system. We’re also expecting to remove a few hundred thousand keywords from being tracked in the old interface that have been migrated to our Partner API for data collection.

If you have a paid account and haven’t been moved yet, you’re on our migration list and you’ll be moved ASAP. If you would like to get started on the new interface and not wait for our migration, you can sign up for a new account, organize your URLs and keywords in the new account, then let us know you’ve made the switch. At that point, we’ll migrate your billing into the new interface and you’ll have access to both the new and old interface for at least 2 months or once we have migrated your historical data. [Read more...]

AuthorityLabs Update: New Interface, New Tools Coming, and Search Bash

We’ve been hard at work here at AuthorityLabs for the past few months and all that work is finally starting to be visible to those of you using our reporting and data.

New Interface

As some of you have already noticed, we quietly rolled out a new interface a couple weeks ago. All new accounts are being added to the new system and we have been working with existing users to migrate their data as well. The new interface is a complete rebuild and will result in faster, more reliable data.

Feature Updates

  • When you add keywords, we typically return ranking data on those within 30 minutes.
  • More reliable data that is pulled in via our Partner API, which has been in use by many other industry leading SEO tools for over a year.
  • New graphs that are more responsive
  • Due to popular demand, we’ve added a new plan called “Pro Plus” that offers 2500 keywords and 150 domains.
  • Streamlined signup and setup so you can start your 30 day trial quickly and we still don’t require any credit card info to get started.
  • Each user now has their own “account” which will allow you to manage multiple client accounts with a single login. An unlimited number of users is still free.

[Read more...]

Crawling as a Service From AuthorityLabs – Get 1 Million Pages Free

Want to crawl a site for outbound link data? Perhaps you’d like to easily analyze header tags across your entire site. You could aggregate a ton of publicly available data from around the web.

We’re excited to announce that we now have a general crawling as a service API endpoint live and in beta. We’ve been playing with the idea of providing a general crawling as a service API for a while now and after some initial development and testing, we are making it available on Partner API accounts.

We’re planning on needing to scale this to hundreds of billions of requests a month and in order to do that carefully and smoothly, if you are interested, you will need to contact us to get started. We just want to make sure we can maintain performance at the volume people will need. We’re already easily processing billions of pages, but we still want to make sure we’ve got our sh*t together.

We haven’t made the docs for this service publicly available yet. It seems each person we’ve worked with so far is interested in something pretty specific, which is why we want to work with each of you closely. We are already parsing out a lot of the data you can expect in a typical HTML page (title, description, H1s, links, etc. – see this gist for an example) and are working on adding more options every day. We want to know what kind of things people need in the default JSON version of a page so if you have ideas, definitely let us know.

If you’re looking to get started and run Ruby, check out our Partner API Ruby Gem.

When you get signed up for our Partner API, we’ll credit your account for 1,000,000 pages of free crawling. Contact us for more information.

The Future

Imagine being able to…

  1. Write a little bit of code.
  2. Upload that as a plugin.
  3. Call that plugin using a parameter in your POST request along with the URL to crawl.
  4. GET the JSON version of that page with plugin specific data appended to the default data we already parse out.

Well, that’s what we’re wrapping up right now as one of the next features for the Partner API and crawling as a service. If you’d like to get started, please contact us for more information.

AuthorityLabs Updates April 2012. New Interface Coming and Partner API Features.

We’ve been pretty busy here at AuthorityLabs lately. It’s probably about time we start letting everyone in on some of the cool things we have going on.

Rank Tracking Interface

As many of you know, our old (nearly 3 years now) system has hiccups from time to time. We’ve improved performance on that quite a bit lately and we’ve had good feedback on that. Toward the end of 2011, we started planning and development on an entirely new interface and backend. The new system will result in even more reliability, speed, and eventually a lot of cool new features. We will be looking to migrate some existing accounts to the new system within the next month or so and at that point, all new accounts will be on the new system. Here’s a sneak peek at the new look.

Partner API

Our developers have been working long hours to add new features and engines to our Partner API. Just supplying organic SERP data hasn’t been good enough for us. Our goal is to give our partners everything they need to build their own tools, reporting, and decision making systems.

More Engines and Locales

We now support ALL official versions of Google, Yahoo! and Bing, so those of you who have clients asking for rankings on Google Maldives, you can now provide that data. ;)

We’re also excited to tell you we’ve added Yandex and Baidu to the Partner API which are currently in beta. We tested these pretty extensively and they seem to be working great. Simply send over the engine parameter ‘baidu’ or ‘yandex’ with a keyword and you can start getting data from those. Drop us a note if there’s more you’d like to see parsed out of those SERPs into the JSON version.

Supported Locale API Calls

Our API now has endpoints for you to easily digest and update the locale codes we support. Provided within the response are human readable descriptions along with the URL for the usable version of that engine. These should be very useful for easily updating locales within your app, and easily providing your users human friendly drop-downs.

Google Ads

Several of our partners asked for ad information and we’re now parsing ads out of Google’s search results pages and providing that to you in an easy to parse JSON format. There’s a new section below the ‘serp’ called ‘ads’ which you’ll find JSON formatted Google ads if they appeared on the SERP we were served. Click here for an example.

As part of that ad data, we’re pulling out the destination_url, headline, raw_destination_url, description, ad_location and display_url. We give you both a clean version of the destination URL and the actual one Google’s serving. We’re also giving you the location of the ad found on the page.

Queue Status

The Partner API has an endpoint that allows you to get your account limits and currently hourly usage ({id}.json). Now included in that is the current hours to deliver on the delayed queue. This is really useful for understanding roughly how full our queues are; specifically, how long you can expect between POSTs to the delayed queue and when results are available. The values in these fields will either be a 6, 12, 18 or 24. When a 12 is returned you can expect results to be available between 6 and 12 hours after you POST. When a 24 is returned you can expect results to be available between 18 and 24 hours after you POST. This should give you a good idea of how busy we are at any given time. We’re also returning this data when you make a successful POST response if you’d like to grab it from that.

We’ve also added a system message within the JSON for account limits and queue status. A lot of you have internal dashboards for various data collection tasks. Now you can easily stay on top of the status of your account and the Partner API as a whole while getting updates from us directly in what you look at daily.

Partner API Tools

One of our goals is to make our data as easy to access as possible. As a result of that, we’ve posted several packages in different languages to help get you going on using the Partner API. Here’s a list of what we have so far:





We’re also working on a basic turnkey tool that can easily be installed on your own server to get you started on the Partner API with pretty much no development time needed. The first one we will roll out is in PHP and should be in beta testing sometime in the next couple weeks. If you’d like to get started on the Partner API and become a beta tester for the new PHP rank tracking tool we’re working on, contact us for more information. If you sign up for an account and get started as a beta tester, we’ll throw some free Partner API usage your way.

Other Cool Stuff

Our partners are constantly rolling out new tools and reporting based off of our API data. Usually those tools are in-house and private. One partner recently decided to take their internal tools and turn them into an app that lets anyone check their rankings. Where I Rank was launched earlier this week and from what we’ve seen, it’s a pretty cool tool for quickly checking rankings on a few keywords without having to wade through pages and pages of SERPs.

If you’ve built some cool tools with our data and would like to have it featured here, shoot us a message and we’ll get on it.

Design Intern

AuthorityLabs is looking for a design intern to help with various design projects we have from time to time. We’ve posted design jobs in quite a few places and hopefully we’ll end up with someone that fits our needs. If you know someone looking to get some experience, please have them submit their resume.