OpenLogReplicator icon indicating copy to clipboard operation
OpenLogReplicator copied to clipboard

Feature: Allow sending DMLs to different Kafka topics based on table name

Open bersler opened this issue 3 years ago • 4 comments

Is your feature request related to a problem? Please describe. Currently all transactions are sent just to one Kafka topic.

Describe the solution you'd like It would be useful to divide the load into multiple topics and send transactions to certain topic based on table name or other conditions.

Describe alternatives you've considered To divide the load - such spread of transactions to multiple Kafka topics can be made as an another level of transaction processing.

Additional context Dividing transactions might mean that we lose transaction consistency.

bersler avatar Feb 06 '23 02:02 bersler

This feature is complicated to implement.. If there is a demand from users more focus could be given here.

bersler avatar Feb 06 '23 02:02 bersler

Hi Adam, I think this feature very useful for resource. (reduce the number of instance OpenLogReplicator ).

Regards, Son

sonnguyen-dba avatar Mar 30 '23 15:03 sonnguyen-dba

Thanks @sonnguyen-dba , I agree. This might help user a lot.

bersler avatar Apr 02 '23 23:04 bersler