Richard Caudle | 9th January 2014
The launch of DataSift VEDO introduced new features to allow you to add structure to social data. Alongside VEDO we also introduced the DataSift library - a great new resource to inspire you and make your life easier. Benefit from our experience and build better solutions faster.
What? Why? Where?
We've introduced the DataSift library to help you to benefit from our experience working with our customers. CSDL (our filtering and tagging language) is extremely powerful, but it might not be clear exactly what can be achieved. Using the library we'll share with you definitions we've written for real-world solutions so you can learn quicker and get the most from our platform.
Currently the library contains tagging and scoring definitions that demonstrate the power of VEDO. There are out-of-the-box components you can use straight away, and example rules you can take and run with.
You'll find the new Library as a new tab on the Filters page:
Supported Out-Of-The-Box Components
Items marked as 'supported' in the library are definitions you can count on us to maintain. You can confidently use these as part of your solution immediately.
You can also use these definitions as a base to start from. You can copy the definitions into your account and modify the rules to fit your use case. After all 'spam' for one use case can be gold for another!
Supported items include:
- Competitions & Marketing: Scores content to say how likely it is to be noise from competitions and marketing campaigns.
- Twitter Application Used: Identifies and categorises the source application used to create a tweet - great for picking out content from services, real users and bots.
- Professions & Roles: Where possible identifies user's profession and seniority based on their profile description.
Real-World Example Solutions
Items marked as 'example' in the library are definitions which we've built that will help you learn from real-world samples. You can run these examples directly, but we envisage you using these definitions as starting points and modifying or extending them to fit your solution.
Example items include:
- News Providers & Topics: Classifies news content being shared by provider and top-level topic.
- NFL Fans: Identifies NFL fans from their profile details.
- Automotive Classifier: Picks out makes and models of cars being discussed on Tumblr.
Using a Library Item
It's easy to make use of a library item. You can either import an item into one of your streams, or copy an item into your account and modify it to your heart's content.
Note that all of the library items are currently tagging and scoring rules. You'll need to use them with a return statement. For more details please see our technical documentation.
Importing a definition
At the bottom of the page for each library item you'll find a tab labelled Usage Examples. This tab shows you example code which you can copy and paste into a new stream and run a live preview.
The key here is the tags keyword and hash for the stream. You can copy and paste this line into any of your streams to import the tagging rules.
Copying a definition
On each library item page there is a snippet of code that shows you the entire, or part of the definition. You can click the Copy to new stream button to copy the entire definition to your account. You can then inspect and modify the code as you see fit.
More To Follow
We'll work hard on adding more and more items to the library so it becomes an extremely valuable resource. Keep an eye out for new items and please watch this blog for further news.