CDC Feed
Provides real-time input from change data logs of a data source, typically used for with a Samza event runner
Last updated
Core Platform
Provides real-time input from change data logs of a data source, typically used for with a Samza event runner
Last updated
Includes settings required for change data capture flows of a specific data table from . Typically, name of this stream matches the source table name.
While Samza runner CDC configurations are mainly done at system level, Spring runners allow the following configurations on each CDC stream:
parameter.system
Name of the system this stream is based on
mongo_cdc
-
parameter.offset.state
Name of the state that stores CDC resume token
cdc_offset
-
parameter.offset.initial
Initial offset to use, if missing from cdc state
100
-
parameter.asPulse
Whether stream should produce pulses instead of CDC records
true
false
parameter.pollMs
Milliseconds to wait if no new records are received from the stream
5000
1000