From 59f537861ae4e43f23e176df4cde8b89b6bea1dd Mon Sep 17 00:00:00 2001 From: difrin Date: Fri, 15 Mar 2024 13:38:29 +0100 Subject: [PATCH] out_kafka: add support for dynamic/static headers --- pipeline/outputs/kafka.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/pipeline/outputs/kafka.md b/pipeline/outputs/kafka.md index cfe3e4f75..5aa0dd94f 100644 --- a/pipeline/outputs/kafka.md +++ b/pipeline/outputs/kafka.md @@ -17,6 +17,7 @@ Kafka output plugin allows to ingest your records into an [Apache Kafka](https:/ | dynamic\_topic | adds unknown topics \(found in Topic\_Key\) to Topics. So in Topics only a default topic needs to be configured | Off | | queue\_full\_retries | Fluent Bit queues data into rdkafka library, if for some reason the underlying library cannot flush the records the queue might fills up blocking new addition of records. The `queue_full_retries` option set the number of local retries to enqueue the data. The default value is 10 times, the interval between each retry is 1 second. Setting the `queue_full_retries` value to `0` set's an unlimited number of retries. | 10 | | rdkafka.{property} | `{property}` can be any [librdkafka properties](https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md) | | +| Header | Add a HTTP header key/value pair. Multiple headers can be. If static header than use Header key value, if the value is part of the message than use Header key | | > Setting `rdkafka.log.connection.close` to `false` and `rdkafka.request.required.acks` to 1 are examples of recommended settings of librdfkafka properties. @@ -45,6 +46,7 @@ In your main configuration file append the following _Input_ & _Output_ sections Match * Brokers 192.168.1.3:9092 Topics test + Header test test ``` ### Avro Support