This repository was archived by the owner on Dec 19, 2025. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 174
S3FileSink
g9yuayon edited this page Dec 9, 2013
·
6 revisions
S3FileSink uploads messages to designated an S3 bucket. It uses local file sink because it writes messages to disk first, and then uploads a file to S3 when the file is rotated. When the local file sink rotates a file, its Notice would have the list of files to upload. S3FileSink can get the list of files by Notice.recv().
If the default value is not specified, it's required.
| Property | Description | Type | Default value |
|---|---|---|---|
| localFileSink | local file sink configuration | String | |
| bucket | S3 bucket name | String | |
| s3Endpoint | S3 bucket end point | s3.amazonaws.com | |
| maxPartSize | S3 multiple upload max partition size | long | 20971520 |
| concurrentUpload | number of uploading threads | int | 5 |
| notice | It describes Notice interface for how to notify its progress. | Notice | QueueNotice |
| prefixFormatter | It describes RemotePrefixFormatter for how to create a file name. | RemotePrefixFormatter | SimpleDateFormatter |