Augmentation: Links
If you're just getting started with links resolution, here's some recommended reading.
Bitly, DataSift and Links Resolution Blog
Read this excellent blog from Lorenzo Alberton, DataSift's Chief Technical Architect, describing the Bitly data source and the Links augmentation 'under the hood'.
Bitly & Metadata Blog
This blog looks at Datasift's latest link resolution services, including a new partnership with bitly, the #1 link sharing platform, which powers 75 percent of the world’s largest media companies and half of the Fortune 500 companies. With over 20,000 white-labeled domains, bitly generates 200M clicks/day.
Open Graph & Twitter Cards Blog
This blog looks at two powerful protocols, Open Graph from Facebook and Twitter Cards from Twitter. The ideas behind these technologies allow social media sites two provide embedded content accompanied by metadata that describes the content being presented, distributed, and consumed.
Introduction to the Links Augmentation
Our Introduction page explains how the Links augmentation examines links within the content of a message and resolves them to their final endpoint. At the same time it also aggregates the content of the link so that filtering can be performed against the content of the page that the link was pointing at.
| Name | Type | Contents |
|---|---|---|
| links.age | array(int) |
The number of seconds since we first saw a particular link in the Twitter Firehose. |
| links.code | array(int) |
The HTTP status code for the original URL. |
| links.domain | array(string) |
The fully qualified domain name of a link, resolved to the final URL. |
| links.hops | array(string) |
The array of intermediate links that any link posted as a part of an interaction resolves to before DataSift obtains the original URL. |
| links.meta.charset | array(string) |
The character set for the target web page. |
| links.meta.content_type | array(string) |
Content type of the target page. |
| links.meta.description | array(string) |
Description of the target page. |
| links.meta.keywords | array(string) |
Keywords for a target page. |
| links.meta.lang | array(string) |
Language of the target page. |
| links.meta.newskeywords | array(string) |
Keywords accompanying news stories. |
| links.meta.standout | array(string) |
“Standout” content in Google News. |
| links.normalized_url | array(string) |
The normalized version of the original URL. |
| links.retweet_count | array(int) |
The total number of times this link has been Tweeted. |
| links.title | array(string) |
The title of the page the link points to. |
| links.url | array(string) |
The full URL of the page (resolved to the final page). |
| Name | Type | Contents |
|---|---|---|
| links.meta.twitter.app.googleplay.id | array(string) |
The target Android (Google Play) application's ID for this deep-linked content. |
| links.meta.twitter.app.googleplay.name | array(string) |
The target Android (Google Play) application's name for this deep-linked content. |
| links.meta.twitter.app.googleplay.url | array(string) |
The target Android (Google Play) application's URL for this deep-linked content. |
| links.meta.twitter.app.ipad.id | array(string) |
The target iPad application's ID for this deep-linked content. |
| links.meta.twitter.app.ipad.name | array(string) |
The target iPad application's name for this deep-linked content. |
| links.meta.twitter.app.ipad.url | array(string) |
The target iPad application's URL for this deep-linked content. |
| links.meta.twitter.app.iphone.id | array(string) |
The target iPhone application's ID for this deep-linked content. |
| links.meta.twitter.app.iphone.name | array(string) |
The target iPhone application's name for this deep-linked content. |
| links.meta.twitter.app.iphone.url | array(string) |
The target iPhone application's URL for this deep-linked content. |
| links.meta.twitter.card | array(string) |
The type of Twitter Card: summary, photo, or player. |
| links.meta.twitter.creator | array(string) |
The Twitter @username of the content creator. |
| links.meta.twitter.creator_id | array(string) |
Twitter user ID of the content creator. |
| links.meta.twitter.description | array(string) |
A description of the Twitter Card. |
| links.meta.twitter.image | array(string) |
URL of the image attached to a Twitter Card. |
| links.meta.twitter.image_height | array(string) |
Height (in px) of the image. |
| links.meta.twitter.image_width | array(string) |
Width (in px) of the image. |
| links.meta.twitter.player | array(string) |
HTTPS URL to an iframe player. |
| links.meta.twitter.player_height | array(string) |
Height (in px) of an iframe player. |
| links.meta.twitter.player_stream | array(string) |
URL to raw stream that will be rendered in Twitter's mobile applications directly (.mp4). |
| links.meta.twitter.player_stream_content_type | array(string) |
The MIME type/subtype of the media content. |
| links.meta.twitter.player_width | array(string) |
Width (in px) of an iframe player. |
| links.meta.twitter.site | array(string) |
The @username for the website used in a Twitter Card. |
| links.meta.twitter.site_id | array(string) |
Twitter user ID of the content creator. |
| links.meta.twitter.title | array(string) |
The title of a Twitter Card. |
| links.meta.twitter.url | array(string) |
Canonical URL of a piece of Twitter Card content. |
| Name | Type | Contents |
|---|---|---|
| links.meta.opengraph.activity | array(string) |
Open Graph activity metadata. |
| links.meta.opengraph.actor | array(string) |
Open Graph actor metadata. |
| links.meta.opengraph.album | array(string) |
Open Graph album metadata. |
| links.meta.opengraph.article | array(string) |
Open Graph article metadata. |
| links.meta.opengraph.athlete | array(string) |
Open Graph athlete metadata. |
| links.meta.opengraph.author | array(string) |
Open Graph author metadata. |
| links.meta.opengraph.band | array(string) |
Open Graph band metadata. |
| links.meta.opengraph.bar | array(string) |
Open Graph bar metadata. |
| links.meta.opengraph.blog | array(string) |
Open Graph blog metadata. |
| links.meta.opengraph.book | array(string) |
Open Graph book metadata. |
| links.meta.opengraph.cafe | array(string) |
Open Graph cafe metadata. |
| links.meta.opengraph.cause | array(string) |
Open Graph cause metadata. |
| links.meta.opengraph.city | array(string) |
Open Graph city metadata. |
| links.meta.opengraph.company | array(string) |
Open Graph company metadata. |
| links.meta.opengraph.country | array(string) |
Open Graph country metadata. |
| links.meta.opengraph.description | array(string) |
Open Graph description metadata. |
| links.meta.opengraph.director | array(string) |
Open Graph director metadata. |
| links.meta.opengraph.drink | array(string) |
Open Graph drink metadata. |
| links.meta.opengraph.email | array(string) |
Open Graph email address metadata. |
| links.meta.opengraph.fax_number | array(string) |
Open Graph fax_number metadata. |
| links.meta.opengraph.food | array(string) |
Open Graph food metadata. |
| links.meta.opengraph.game | array(string) |
Open Graph game metadata. |
| links.meta.opengraph.geo | geo |
Open Graph geo metadata. |
| links.meta.opengraph.government | array(string) |
Open Graph government metadata. |
| links.meta.opengraph.hotel | array(string) |
Open Graph hotel metadata. |
| links.meta.opengraph.image | array(string) |
Open Graph image URL metadata. |
| links.meta.opengraph.landmark | array(string) |
Open Graph landmark metadata. |
| links.meta.opengraph.locality | array(string) |
Open Graph locality metadata. |
| links.meta.opengraph.movie | array(string) |
Open Graph movie metadata. |
| links.meta.opengraph.musician | array(string) |
Open Graph musician metadata. |
| links.meta.opengraph.non_profit | array(string) |
Open Graph non_profit metadata. |
| links.meta.opengraph.phone_number | array(string) |
Open Graph phone_number metadata. |
| links.meta.opengraph.politician | array(string) |
Open Graph politician metadata. |
| links.meta.opengraph.postal_code | array(string) |
Open Graph postal_code metadata. |
| links.meta.opengraph.product | array(string) |
Open Graph product metadata. |
| links.meta.opengraph.public_figure | array(string) |
Open Graph public_figure metadata. |
| links.meta.opengraph.region | array(string) |
Open Graph region metadata. |
| links.meta.opengraph.restaurant | array(string) |
Open Graph restaurant metadata. |
| links.meta.opengraph.school | array(string) |
Open Graph school metadata. |
| links.meta.opengraph.site_name | array(string) |
Open Graph site_name metadata. |
| links.meta.opengraph.song | array(string) |
Open Graph song metadata. |
| links.meta.opengraph.sport | array(string) |
Open Graph sport metadata. |
| links.meta.opengraph.sports_league | array(string) |
Open Graph sports_league metadata. |
| links.meta.opengraph.sports_team | array(string) |
Open Graph sports_team metadata. |
| links.meta.opengraph.state_province | array(string) |
Open Graph state_province metadata. |
| links.meta.opengraph.street_address | array(string) |
Open Graph street_address metadata. |
| links.meta.opengraph.title | array(string) |
Open Graph title metadata. |
| links.meta.opengraph.tv_show | array(string) |
Open Graph tv_show metadata. |
| links.meta.opengraph.type | array(string) |
Open Graph object type metadata. |
| links.meta.opengraph.university | array(string) |
Open Graph university metadata. |
| links.meta.opengraph.url | array(string) |
Open Graph canonical URL metadata. |
| links.meta.opengraph.website | array(string) |
Open Graph website metadata. |