|
| 1 | +# Kinesis-Sumologic Connector |
| 2 | + |
| 3 | +The **Kinesis-Sumologic Connector** is a Java connector that acts as a pipeline between an [Amazon Kinesis] stream and a [Sumologic] Collection. Data gets fetched from the Kinesis Stream, transformed into a POJO and then sent to the Sumologic Collection as JSON. |
| 4 | + |
| 5 | +## Requirements |
| 6 | + |
| 7 | + + [Java JDK 1.7]: This connector has been built with Java version 1.7. |
| 8 | + + [Ant]: A build.xml script has been provided to build the connector with Ant. |
| 9 | + + [AWS Kinesis Account]: An Amazon AWS Kinesis account to use as a source of data. |
| 10 | + + [Sumologic Account]: A Sumologic account to use as a destination. |
| 11 | + |
| 12 | +## Overview |
| 13 | + |
| 14 | +Incoming records from one (or many) Shards of an AWS Kinesis Stream will be read using the [Kinesis Client Library]. Records will be: |
| 15 | + + **Transformed**: Raw records will be transformed into a POJO using the KinesisMessageModel class and then serialized. |
| 16 | + + **Filtered**: A filter may be applied to the records. Default filter will let all records pass. |
| 17 | + + **Buffered**: A custom buffer may be used to define thresholds that, when crossed, will flush all records into the emitter. |
| 18 | + + **Emitted**: The records will get send to the Sumologic Collector. |
| 19 | + |
| 20 | +## Configuration |
| 21 | + |
| 22 | +A sample properties file is provided, which should be modified to use your AWS Accounts (**accessKey** and **secretKey**), Kinesis Stream(**kinesisInputStream**), Sumologic HTTP source (**sumologicUrl**) and App Name (**appName**). |
| 23 | + |
| 24 | +## Running the Connector |
| 25 | + |
| 26 | +After modifying the .properties file, run the connector by executing the ant build script |
| 27 | +To download the needed dependencies execute **ant setup** |
| 28 | +To build and execute the connector execute **ant run** |
| 29 | + |
| 30 | + |
| 31 | + |
| 32 | + |
| 33 | +[Amazon Kinesis](http://aws.amazon.com/kinesis/) |
| 34 | +[Sumologic](https://www.sumologic.com/) |
| 35 | +[Java JDK 1.7](http://www.oracle.com/technetwork/java/javase/overview/index.html) |
| 36 | +[Ant](http://ant.apache.org/) |
| 37 | +[AWS Kinesis Account](http://aws.amazon.com/account/) |
| 38 | +[Sumologic Account](https://www.sumologic.com/pricing/) |
| 39 | +[Kinesis Client Library](https://github.com/awslabs/amazon-kinesis-client/) |
0 commit comments