-
Notifications
You must be signed in to change notification settings - Fork 20
Description
As a consumer of my CDC event stream (Kafka topic), with table cdc postimages enabled, I'd like to also receive data of the postimage *_cdc_log
record (cdc$operation=9
).
This would allow me to fully utilise the change event for stream processing use cases.
Without the CDC postimage record included to the message to Kafka the change is lost. Enriching the record as part of stream processing not only would result in extra read operations to Scylla (network IO, latency, ..) but it is also impossible to fetch the actual point-in-time row postimage of the change event (since the row might have changed again in the meantime - or no longer exist..)
Optional: either follow the cdc setting of the (source) table in question - or have the scylla-cdc-source-connector
to explicitly configure (enable/disable) processing of postimages.
Example use cases:
- have the full latest record available for operations where not all columns are written, e.g. for streaming to other systems / databases.