Skip to content

Commit ce08c15

Browse files
committed
Document simple_aggregation for kinesis/firehose
Signed-off-by: Shelby Hagman <[email protected]>
1 parent ef0fa03 commit ce08c15

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

pipeline/outputs/firehose.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,7 @@ This plugin uses the following configuration parameters:
2727
| `sts_endpoint` | Custom endpoint for the STS API. | _none_ |
2828
| `auto_retry_requests` | Immediately retry failed requests to AWS services once. This option doesn't affect the normal Fluent Bit retry mechanism with backoff. Instead, it enables an immediate retry with no delay for networking errors, which can help improve throughput when there are transient/random networking issues. | `true` |
2929
| `external_id` | Specify an external ID for the STS API. Can be used with the `role_arn` parameter if your role requires an external ID. | _none_ |
30+
| `simple_aggregation` | Enable simple aggregation to combine multiple records into single API calls. This reduces the number of requests and can improve throughput. When enabled, multiple log records are concatenated with newlines and sent as a single record to Firehose, up to the maximum record size limit (1,024,000 bytes). | `false` |
3031
| `profile` | AWS profile name to use. | `default` |
3132
| `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `1` |
3233

pipeline/outputs/kinesis.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,7 @@ For information about how AWS credentials are fetched, see [AWS credentials](../
2727
| `sts_endpoint` | Custom endpoint for the STS API. | _none_ |
2828
| `auto_retry_requests` | Immediately retry failed requests to AWS services once. This option doesn't affect the normal Fluent Bit retry mechanism with backoff. Instead, it enables an immediate retry with no delay for networking errors, which might help improve throughput when there are transient/random networking issues. | `true` |
2929
| `external_id` | Specify an external ID for the STS API, can be used with the `role_arn` parameter if your role requires an external ID. | _none_ |
30+
| `simple_aggregation` | Enable simple aggregation to combine multiple records into single API calls. This reduces the number of requests and can improve throughput. When enabled, multiple log records are concatenated with newlines and sent as a single record to Kinesis, up to the maximum record size limit (1,048,556 bytes). | `false` |
3031
| `profile` | AWS profile name to use. | `default` |
3132
| `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `1` |
3233

0 commit comments

Comments
 (0)