kafka icon indicating copy to clipboard operation
kafka copied to clipboard

KAFKA-7663: initial commit for reprocessing on user added stores

Open wcarlson5 opened this issue 1 year ago • 1 comments

When custom processors are added via StreamBuilder#addGlobalStore they will now reprocess all records through the custom transformer instead of loading directly.

We do this so that users that transform the records will not get improperly formatted records down stream.

Committer Checklist (excluded from commit message)

  • [ ] Verify design and implementation
  • [ ] Verify test coverage and CI build status
  • [ ] Verify documentation (including upgrade notes)

wcarlson5 avatar Feb 21 '24 22:02 wcarlson5

I might need to add a couple of unit tests, but I think it could use a review when you got time @mjsax !

wcarlson5 avatar Feb 23 '24 21:02 wcarlson5

@mjsax I added some testing that you asked for

wcarlson5 avatar Mar 18 '24 17:03 wcarlson5

Jenkins needs a re-run...

mjsax avatar Mar 26 '24 22:03 mjsax

Test configuration issues in the build is in `core:test' and not related to this PR

wcarlson5 avatar Mar 28 '24 15:03 wcarlson5