Open Data Processing for Twitter - Now Available

Following Twitter's announcement to terminate their partnership with DataSift, we've been working hard to build a solution to help our customers fill gaps left by the transition to Gnip. We've now released an open-source connector for you to install on your infrastructure (or a platform such as AWS) which will take data from the Gnip API and feed this into the DataSift platform. Hopefully this component will make your transition as pain-free as possible. DataSift's open-...

Read Open Data Processing for Twitter - Now Availableimageimage

Transitioning to GNIP: Feature Gaps vs DataSift

Twitter has terminated their partnership agreement with DataSift, meaning that as of August 13th 2015, companies will need to license Twitter data directly from GNIP.    From our analysis, 80% of our customers leverage capabilities which are absent in GNIP. The goal of this post is to highlight the main functional areas that will be impacted by transitioning to GNIP, to enable our customers to evaluate the features that may need to deprecate from their products, or identify the...

Read Transitioning to GNIP: Feature Gaps vs DataSiftimageimage

DataSift PYLON - The value of unified data processing

Applying CSDL and VEDO to Facebook topic data You might have seen our recent announcement which enables developers to gain insights from Facebook topic data. No doubt you're eager to learn more! In this post we'll look at how easy it is to take CSDL you've fine-tuned for filtering data from networks such as Twitter or Tumblr, and apply this in PYLON both for not only filtering but also for classifying Facebook topic data. This demonstrates the simplicity of using a unified data...

Read DataSift PYLON - The value of unified data processingimageimage

New Community Site Launched!

Things change very fast at DataSift, it can be hard to keep up.   This week we've released our new community site at       The community site hosts our forums going forwards. It's the best place to ask questions to be answered by our staff and other developers, and you can also leave feedback and make suggestions to our team.   Another role of the community site is to keep you better informed of platform changes and...

Read New Community Site Launched!imageimage

How To Update Filters On-The-Fly And Build Dynamic Social Solutions

It would be easy if the world around us was static, but in practice things are always changing. Nowhere is this truer than in the world of social networks; users are constantly following new friends and expressing new thoughts. The filter you wrote yesterday is probably already out-of-date!    On the DataSift platform you can update your filters on the fly via the API and avoid downtime for your application. This not only allows you to adapt to real-world changing scenarios,...

Read How To Update Filters On-The-Fly And Build Dynamic Social Solutionsimageimage