Kafka Topic
Maps input/output connections to a topic on a specific Kafka cluster, typically used for async operations using a Samza event runner
Includes settings required for consuming or producing to a Kafka topic.
Setting
Definition
Example
Default
streams.$alias.*
Samza specific settings for the Kafka topic
samza.offset.default=upcoming
-
parameter.broadcast
Whether topic should be broadcasted or consumed as partitions
true
false
parameter.consumer.[property]
Kafka consumer properties
auto.offset.reset=earliest
-
parameter.producer.[property]
Kafka producer properties
acks=0
-
parameter.output.backupSystem
Name of backup system to use if this stream fails
kafka_backup
-
parameter.output.backupStream
Name of backup stream to use if this stream fails
journal_backup
-
Last updated