Billing FAQ

For more details, take a look at our Understanding Billing page.


How do I determine the total cost of running a filter?

The total cost of running a filter depends on the complexity of the filter (which we measure in DPUs), how long you run the filter for, and the number of interactions it produces.

For example, each Tumblr interaction that we deliver to you costs $0.0002. If you create a filter that costs 1 DPU and run it for 6 hours, and receive 4,000 Tumblr interactions, the cost will be:

   1 * 6 * 0.20 + 0.0002 * 4000  =  $2.00

You cannot predict the license fee in advance because it is impossible to predict how many messages users will post. News stories, by their very nature, often come as complete surprises. However, you might decide to make an estimate of the traffic a stream will generate by running a test, either via DataSift's API or UI, for a few minutes and extrapolating those results.

How do I determine the total cost of running a Historics query?

The cost of running a Historics query depends on data processing usage plus the licensing costs. Data processing usage is calculated based on the duration of the Historics query and the sample size of the output data; it is deducted from the monthly DPU usage. Licensing costs depend on the volume of data retrieved.
For example, you created a Historics Query of a simple stream costs 0.1 DPU, for the timeframe of one month, with 10 percent as the sample output data size. The data processing usage for this Historics query is calculated to be 288 DPU and it is deducted from your monthly DPU allowance. As per the usage statistics, the volume of data retrieved is a total of 1,212,194 augmentations and sources. Since Tumblr charges $0.20 for every 1000 interactions that we retrieve for the query, the licensing costs of the Historics Query will be $242.44 approximately.

What are licensing fees?

DataSift charges licensing fees on behalf of our partner sites. The license fee that you pay is exactly proportional to the number of objects your stream produces. Or, in the case of Historics queries, the number of objects retrieved by your query.

If want to create very highly targeted streams, you should typically expect to receive a low volume of data and so your license fees will be very low. For example, a filter for all messages about hippopotamuses sent within a radius of 20 miles of San Diego zoo, isn't going to generate very much output, even on days when the hippos do something exceptional.

On the other hand, a filter that looks for any mention of, say, coffee will probably generate substantially more output and cost more in license fees.

What's a DPU?

A DPU is a Data Processing Unit, a reflection of the computational complexity for the processing that you perform on the DataSift platform. A higher number represents a more complex stream. We measure DPUs on a per-hour basis because running a stream for five hours costs five times as much as running it for one hour.

What is the cost of running a 1 DPU stream for one hour?

This will depend on the size of the subscription you have purchased. The default cost is 20 US cents.

What if I stop a Historics query midway? Will I still be charged for it?

Yes, you will be charged even if you stop a Historics query midway. You will be charged for the licensing costs of the volume of data retrieved until you stopped the query. The data processing usage until you stopped the query will also be deducted from your monthly DPU usage.

What's the difference between credits and DPUs?

You purchase credits on the DataSift platform. Credits are priced in US dollars.

A credit costs $1. One credit is equivalent to 5 DPUs so the effective price of one DPU is 20 cents.

Why do you charge using DPUs?

DataSift believes customers should only pay for what they consume. DataSift is a cloud platform, allowing you to consume only what you need and retain the flexibility to scale, either up or down, whenever necessary. The DPU amount that you pay is determined by the complexity of the rules you create.

What are the benefits of this flexible pricing?

Applications need to handle dynamic loads to survive. DataSift provides dynamic vertical scaling to handle unexpected data spikes as well as horizontal build out to support application growth over time.

How can I optimize my streams to use fewer DPUs?

Visit our Optimization page first. If you need further guidance, please contact our Support team.

How can I check my billing?

Via the REST API:
For Streams, hit the /dpu endpoint to find details of DPUs for a stream.
For Streams, hit the /usage endpoint to find how many objects DataSift has delivered to you.
For Historics queries, hit the historics/prepare endpoint to get details of DPUs for your Historics query.

Via the DataSift UI, visit our Billing page.

Why is my DPU cost higher than I expected?

The minumum DPU charge is currently 1 DPU per hour, no matter how simple your stream is.

If you run just one stream that costs just 0.1 DPU, the total charge is 1 DPU per hour, which equates to 20 cents. In other words, the minimum DPU cost to use the platform is 20 cents per hour.

However, if you run ten streams, and they all cost 0.1 DPU, DataSift will still charge only 1 DPU per hour for all ten.

Why can't I pay a fixed price?

You can pay a fixed price for the processing but not for the licensing. We offer a range of subscriptions which include prepaid DPUs. The license cost of the content is variable and depends on the number of objects your stream returns. Clients who choose to prepay for DPUs benefit from a discount.

What is the charge for a Historics Preview?

Each request has a fixed cost of 10 DPUs plus 2 DPUs per day. For example:

  • 1 day = 12 DPU
  • 30 day = 70 DPU

There are no licensing fees charged for a Historics Preview since you will not receive any of the interactions that match your filter, you will ony receive aggregate statistics for your selected filter.

Billing for Managed Sources

Billing for Managed Sources has two components:

  • There is a charge for the complexity of your query, based on the number and type of operators.
  • Each source is also billed as follows:

    Facebook Pages

    50 DPUs per Facebook page per month.

What happens if I push a stream to two different destinations simultaneously?

If you create a filter and run it twice, sending to two different destinations simultaneously, you will be billed once for the DPUs you receive and once for the data license fee.

This is true for both our Streaming API and our Push delivery mechanism. The only condition is that you must be consuming the same stream hash for the cost deduplication to apply.

When am I billed for the interactions I consume?

Interactions are charged to your account at the time the interactions are made available for you to consume. For example, this might be the moment an interaction is written into your Push delivery buffer.