What is a Connector?
NoteAll of the connectors are available to customers on the Enterprise Edition but the Pay-As-You-Go plan and the Professional Edition include only a subset of the connectors.
|Connector||Status||Throughput limit per delivery||Enterprise Edition Only|
Variable, based on your configuration *
|Splunk Storm REST||beta||10MB||Yes|
* Amazon generally limits users to 5MB but you can contact them to discuss your account and potentially increase your usage.
DynamoDB and S3 are part of Amazon Web Services. You have to set up delivery points for other connectors on your own servers, or you can lease servers from a number of hosting companies. If you do not want a long-term comittment, Amazon Web Services offer EC2 cloud servers that you can use for that purpose.
How do I set up a connector?
Each connector has its own set of parameters. For example, for FTP, you would specify a username, password, and directory whereas for HTTP you would need to specify parameters such as the URL of the endpoint your data will go to.
To get started with Push, prepare all the parameters you'll need to use with the connector you've chosen; make sure you have all of the passwords, keys, and so on, ready. Then, hit the /push/create endpoint. It requires a hash (if you're running a stream) or a Historics id (if you're running a query against Historics data).
What format do you use for the data ?
We deliver data to you in JSON format. JSON is a sreamlined, lightweight format that is easy to parse and easy for humans to interpret. Free resources such as jsonlint.com exist to format raw JSON to make it as human-readable as possible. If you're new to this format, take a look at our Understanding JSON page to get started.