Skip to content

Commit d7da3c5

Browse files
Juan Pablo Diaz-VazJuan Pablo Diaz-Vaz
authored andcommitted
Added properties file sample and readme
1 parent 401bec3 commit d7da3c5

2 files changed

Lines changed: 53 additions & 7 deletions

File tree

README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -4,23 +4,23 @@ The **Kinesis-Sumologic Connector** is a Java connector that acts as a pipeline
44

55
## Requirements
66

7-
+ [Java JDK 1.7]: This connector has been built with Java version 1.7.
8-
+ [Ant]: A build.xml script has been provided to build the connector with Ant.
9-
+ [AWS Kinesis Account]: An Amazon AWS Kinesis account to use as a source of data.
10-
+ [Sumologic Account]: A Sumologic account to use as a destination.
7+
+ **Java JDK 1.7**: This connector has been built with Java version 1.7.
8+
+ **Ant**: A build.xml script has been provided to build the connector with Ant.
9+
+ **AWS Kinesis Account**: An Amazon AWS Kinesis account to use as a source of data.
10+
+ **Sumologic Account**: A Sumologic account to use as a destination.
1111

1212
## Overview
1313

1414
Incoming records from one (or many) Shards of an AWS Kinesis Stream will be read using the [Kinesis Client Library]. Records will be:
1515

16-
+ **Transformed**: Raw records will be transformed into a POJO using the KinesisMessageModel class and then serialized.
16+
+ **Transformed**: Raw records will be transformed into a POJO using a Kinesis Model class and then serialized. The transformer used will be specified in the properties file.
1717
+ **Filtered**: A filter may be applied to the records. Default filter will let all records pass.
1818
+ **Buffered**: A custom buffer may be used to define thresholds that, when crossed, will flush all records into the emitter.
1919
+ **Emitted**: The records will get send to the Sumologic Collector.
2020

2121
## Configuration
2222

23-
A sample properties file is provided, which should be modified to use your AWS Accounts (**accessKey** and **secretKey**), Kinesis Stream(**kinesisInputStream**), Sumologic HTTP source (**sumologicUrl**) and App Name (**appName**).
23+
A sample properties file is provided, which should be modified to use your AWS Accounts (**accessKey** and **secretKey**), Kinesis Stream(**kinesisInputStream**), Sumologic HTTP source (**sumologicUrl**), App Name (**appName**) and Transformer class used (**transformerClass**).
2424

2525
## Running the Connector
2626

@@ -43,4 +43,4 @@ To build and execute the connector execute **ant run**
4343

4444
[Sumologic Account](https://www.sumologic.com/pricing/)
4545

46-
[Kinesis Client Library](https://github.com/awslabs/amazon-kinesis-client/)
46+
[Kinesis Client Library](https://github.com/awslabs/amazon-kinesis-client/)

SumologicConnector.properties

Lines changed: 46 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
1+
# Fill in your AWS Access Key ID and Secret Access Key
2+
# http://aws.amazon.com/security-credentials
3+
accessKey = [ACCESS-KEY]
4+
secretKey = [SECRET-KEY]
5+
6+
# KinesisConnector Application Settings
7+
# Since Kinesis Creates a DynamoDB table for each APP,
8+
# each appName must be unique for different kinesisInputStreams and connectorDestinations
9+
appName = kinesisToSumologicConnector
10+
11+
# By specifying the region name, the connector will connect from the Amazon Kinesis stream in this region
12+
# unless the endpoint for Amazon Kinesis is explicitly specified. The Amazon DynamoDB lease table and Amazon CloudWatch
13+
# metrics for connector will be created in this region. All resources in outgoing destination will
14+
# not be affected by this region name.
15+
regionName = us-east-1
16+
retryLimit = 3
17+
18+
# Amazon Kinesis parameters for KinesisConnector
19+
20+
# Uncomment the following property if you would like to explicitly configure the Amazon Kinesis endpoint.
21+
# This property will configure the connector's Amazon Kinesis client to read from this specific endpoint,
22+
# overwriting the regionName property for ONLY the Amazon Kinesis client. The lease table and Amazon CloudWatch
23+
# metrics will still use the regionName property.
24+
# kinesisEndpoint = https\://kinesis.us-west-2.amazonaws.com
25+
26+
# Kinesis Stream where data will be grabbed from
27+
kinesisInputStream = [STREAM-NAME]
28+
29+
# Optional Amazon Kinesis parameters for automatically creating the stream
30+
createKinesisInputStream = false
31+
createKinesisOutputStream = false
32+
kinesisInputStreamShardCount = 2
33+
kinesisOutputStreamShardCount = 2
34+
35+
# Transformer class that will be used to handle records
36+
transformerClass = CloudWatchMessageModelSumologicTransformer
37+
38+
# Specifies the input file from which the StreamSource will read records
39+
createStreamSource = false
40+
inputStreamFile = users.txt
41+
42+
# Connector name to be appendend to the UserAgent
43+
connectorDestination = sumologic
44+
45+
# Sumologic HTTP Collector URL
46+
sumologicUrl = [SUMOLOGIC-COLLECTOR]

0 commit comments

Comments
 (0)