Recently Updated Documentation

Updated on Thursday, 29 May, 2014 - 10:45

December 12, 2013

Document Version Description
Tagging and Scoring 2.00 New release of CSDL tags including new scoring feature along with namespacing.
wildcard 1.00

New wildcard operator.

WordPress 1.00 WordPress is now available as a Data Source. These are the targets you can filter on.
IntenseDebate 1.00 IntenseDebate is now available as a Data Source. These are the targets you can filter on.

 

December 2, 2013

Document Version Description

Understanding Billing

Billing FAQ

1.20

Billing for Managed Sources.

 

October 8, 2013

Document Version Description

Push Status Codes

1.10

New status code, finishing_paused. 

 

October 1, 2013

Document Version Description

Using Managed Sources

1.00

Blog for new users to explain how to use Managed Sources.

/source/create 1.10

We have restructured the documentation for the /source/create endpoint. The options for each managed source are now on individual pages:

twitter.user.lang 1.20

New language codes:

  • Latvian (lv)
  • Norwegian Bokmål (nb)
  • Slovene (sl)

 

September 25, 2013

Document Version Description

Billing FAQ

1.10

Updates for new Historics Preview pricing calculation.

Understanding Billing 1.10 Updates for new Historics Preview pricing calculation.

 

September 17, 2013

Document Version Description
Tumblr targets 1.00

Family of 49 Tumblr targets.

See also:

     What's in Interaction?

     Reference: Stream Output Elements

     interaction.type

     interaction.subtype

 

September 11, 2013

Document Version Description
facebook.place.* targets 1.00

Set of eight new Facebook targets:

    facebook.place.id

    facebook.place.name

    facebook.place.location.street

    facebook.place.location.name

    facebook.place.location.city

    facebook.place.location.state

    facebook.place.location.country

    facebook.place.location.zip

 

September 9, 2013

Document Version Description
Japanese Chunking 1.00 Automatic word boundary detection optimizes filtering accuracy.

 

August 27, 2013

Document Version Description
Mandatory messages 1.10 Restructure, include scrub_geo messages.

 

August 7, 2013

Document Version Description
interaction.author.language 1.00 New target.

 

August 2, 2013

Document Version Description
Pull connector 1.00 How to use the new Push Pull connector. 

/pull REST endpoint

1.00

The /pull endpoint in the REST API.

Pull connector blog post 1.00 The Push Pull connector made simple.

 

July 29, 2013

Document Version Description
Yammer Managed Source 1.00 How to use Yammer as a Managed Source. 

Yammer targets

1.00

Yammer targets.

Best Practices for Token Management 1.10 Update to include Yammer.

 

July 2, 2013

Document Version Description

API versioning

1.00

Updated API documentation with examples of API versioning. The current API version is v1.

 

July 1, 2013

Document Version Description

Tokenization and the CSDL Engine

2.00

Updates, plus new subpages that describe the keep and case switches for the contains family of operators. Also, details of the classic, default, and extended punctuation character sets.

Best Practices for Token Management

1.00

How to obtain and use access tokens and other authentication credentials for use with DataSift Managed Sources.

 

June 27, 2013

Document Version Description

source.id

1.00

New target: Managed Source ID.

 

June 21, 2013

Document Version Description

twitter.user.*.* languages

1.10

Twitter introduced UK English (en-gb) as a new language code.

 

June 17, 2013

Document Version Description

CouchDB

1.20

From now on, our CouchDB Push Connector will only work with CouchDB 1.3.x or later.

 

June 14, 2013

Document Version Description

IP Addresses for Push

1.01

We've added one new address range.

interaction.subtype

1.00

New target: interaction.subtype

Splunk Storm Connector

1.02

Splunk Storm Connector has been deprecated.

 

June 6, 2013

Document Version Description

Historics FAQ

1.00

Everything you ever wanted to know about DataSift's Historics archive.

Managed Sources

1.00

Introduction to Managed Sources.

Facebook Pages

1.00

Introduction to the Facebook Pages Managed Source.

Google+

1.00

Introduction to the Google+ Managed Source.

Instagram

1.00

Introduction to the Instagram Managed Source.

Managed Sources API Step-by-Step Guide

1.00

Introduction to the Managed Sources API.

Facebook Pages (targets)

1.00

Targets for the Facebook Pages Managed Source.

Google+ (targets)

1.00

Targets for the Google+ Managed Source.

Instagram (targets)

1.00

Targets for the Instagram Managed Source.

 

June 5, 2013

Document Version Description

Sample Output for Database Connectors

1.00

Samples of three new output formats used by the following Push Connectors: CouchDB, Elasticsearch, MongoDB.

CouchDB

1.10

New output formats added to the CouchDB Push Connector.

Elasticsearch

1.10

New output formats added to the Elasticsearch Push Connector.

MongoDB

1.10

New output formats added to the MongoDB Push Connector.

 

May 29, 2013

Document Version Description

Response Codes

2.00

Updated to show the HTTP return codes that you will receive on successful execution of each REST endpoint call.

 

May 24, 2013

Document Version Description

newscred.source.circulation

2.00

The newscred.source.circulation target now takes an integer argument rather than a string. Filters can now use the greater than and less than operators with this target.

Streaming API Error Messages

2.00

Updated list of error messages returned by the DataSift Streaming API.

 

May 22, 2013

Document Version Description

wikipedia.comment

1.00

New Wikipedia target. It contains the author's comment, left after an edit.

 

May 14, 2013

Document Version Description

What's in Interaction?

1.00

This is a first cut, showing the mappings of all the existing targets to the Interaction augmentation.

 

May 10, 2013

Document Version Description

Tokenization and the CSDL engine

1.10

Update the list of punctuation characters to include CJK punctuation.

 

May 3, 2013

Document Version Description

Reference: output elements in DataSift streams

1.00

Reference list of all output elements in our streams

 

April 24, 2013

Document Version Description

interaction.mentions

interaction.mention_ids

1.00

New Common: Interaction targets.

 

April 22, 2013

Document Version Description

twitter.user.favourites_count

twitter.symbols

twitter.retweet.symbols

1.00

New Twitter targets.

 

April 10, 2013

Document Version Description

Precog

1.00

New Push connector.

Splunk Storm REST

1.00

New Push connector.

Zoomdata

1.00

New Push connector.

 

April 9, 2013

Document Version Description

Regular Expressions

Regular Expressions: Examples

Escaped Characters

2.00

Updates to our Regex and escaping pages.

 

April 4, 2013

Document Version Description

List of Languages we Detect

1.00

Complete list of the languages our Language augmentation can detect.

 

March 25, 2013

Document Version Description

What is Historics Preview?

1.00

Take a peek into our Historics archive before you run a Historics query.

Historics Preview API: Step-by-Step 1.00 With links to the new preview/create and preview/get endpoints.

 

March 21, 2013

Document Version Description

Historics Archive Schema

1.10

Addition of Facebook, Bitly, Demographics, and Newscred.

 

March 19, 2013

Document Version Description

historics/get endpoint

1.10

The with_estimate parameter is now available.

Google Big Query connector

1.00

This new connector is now available

 

February 27, 2013

Document Version Description

Storage and Access of Filter Definitions

1.00

Security information.

 

February 14, 2013

Document Version Description

Continuous Delivery

1.00

Our Push connectors now offer the option of continuous data delivery rather than delivery data at intervals set by the  output_params.delivery_frequency parameter in the Push API.

 

February 13, 2013

Document Version Description

Redis connector

1.00

The new Redis connector is available now.

 

February 8, 2013

Document Version Description

Connecting the Query Builder to DataSift

1.00

After you've embedded the Query Builder, here's how to hook it all up to DataSift.

 

February 5, 2013

Document Version Description

Tokenization and the CSDL Engine

1.01

This is for advanced users. It has a link on our main developer documentation page dev.datasift.com/docs under the Programming heading.

 

February 5, 2013

Document Version Description

Understanding Billing

1.00

The DPU cost of the contains_near operator has decreased from 0.5 to 0.2.

 

January 22, 2013

Document Version Description

CSDL url_in operator.

1.00

url_in performs an exact match against a URL. It works with the links.url and links.hops targets only.

 

January 7, 2013

Document Version Description

New Twitter target now available.

1.00

twitter.retweet.mention_ids

 

January 4, 2013

Document Version Description

Updates to low-level Client Library autodocs for all supported languages

1.01

Java,  Node.JS,  PHP,  Python,  Ruby,  .Net

 

 

December 19, 2012

Document Version Description

push/create

1.00 Added information about the new start and end parameters.

DataSift PHP Client Library autodocs

1.00 Updated documentation to reflect the latest changes to the master branch. This version is based on this commit.

HTTP Connector
FTP Connector
SFTP Connector
S3 Connector
Splunk Storm Connector

1.01 Added details of the output_params.format parameter, which allows you to select the format that you want for your output data.
Sample Output for File-Based Connectors 1.01 There are now three output examples to illustrate the three different output formats available. You select a format using the output_params.format parameter in your call to the push/create endpoint.

 

December 17, 2012

Document Version Description

API Authentication

1.00 Clarified the need for the correct use of the Auth: header. The pages for our Historics and Push endpoints have also been updated to reflect this change.

 

December 13, 2012

Document Version Description
Augmentation: Demographics 1.00 A set of 19 new targets for DataSift's Demographics augmentation are now live. You can include these in your CSDL filters once you have visited our Data Sources page and enabled Demographics. Note that Twitter and Demographics cannot be active Data Sources at the same time, so turning one on will turn the other off.