Skip to content

Commit ff2ee65

Browse files
Juan Pablo Diaz-VazJuan Pablo Diaz-Vaz
authored andcommitted
SUMOK-9 Added README file
1 parent ca31e0d commit ff2ee65

1 file changed

Lines changed: 39 additions & 0 deletions

File tree

README.md

Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
# Kinesis-Sumologic Connector
2+
3+
The **Kinesis-Sumologic Connector** is a Java connector that acts as a pipeline between an [Amazon Kinesis] stream and a [Sumologic] Collection. Data gets fetched from the Kinesis Stream, transformed into a POJO and then sent to the Sumologic Collection as JSON.
4+
5+
## Requirements
6+
7+
+ [Java JDK 1.7]: This connector has been built with Java version 1.7.
8+
+ [Ant]: A build.xml script has been provided to build the connector with Ant.
9+
+ [AWS Kinesis Account]: An Amazon AWS Kinesis account to use as a source of data.
10+
+ [Sumologic Account]: A Sumologic account to use as a destination.
11+
12+
## Overview
13+
14+
Incoming records from one (or many) Shards of an AWS Kinesis Stream will be read using the [Kinesis Client Library]. Records will be:
15+
+ **Transformed**: Raw records will be transformed into a POJO using the KinesisMessageModel class and then serialized.
16+
+ **Filtered**: A filter may be applied to the records. Default filter will let all records pass.
17+
+ **Buffered**: A custom buffer may be used to define thresholds that, when crossed, will flush all records into the emitter.
18+
+ **Emitted**: The records will get send to the Sumologic Collector.
19+
20+
## Configuration
21+
22+
A sample properties file is provided, which should be modified to use your AWS Accounts (**accessKey** and **secretKey**), Kinesis Stream(**kinesisInputStream**), Sumologic HTTP source (**sumologicUrl**) and App Name (**appName**).
23+
24+
## Running the Connector
25+
26+
After modifying the .properties file, run the connector by executing the ant build script
27+
To download the needed dependencies execute **ant setup**
28+
To build and execute the connector execute **ant run**
29+
30+
31+
32+
33+
[Amazon Kinesis](http://aws.amazon.com/kinesis/)
34+
[Sumologic](https://www.sumologic.com/)
35+
[Java JDK 1.7](http://www.oracle.com/technetwork/java/javase/overview/index.html)
36+
[Ant](http://ant.apache.org/)
37+
[AWS Kinesis Account](http://aws.amazon.com/account/)
38+
[Sumologic Account](https://www.sumologic.com/pricing/)
39+
[Kinesis Client Library](https://github.com/awslabs/amazon-kinesis-client/)

0 commit comments

Comments
 (0)