samza icon indicating copy to clipboard operation
samza copied to clipboard

SAMZA-2353: Support side inputs and standby containers with transactional state

Open bkonold opened this issue 5 years ago • 0 comments

Feature: Consumption of standby side inputs must honor checkpointed changelog offsets, else customers using standby containers cannot enable transactional state.

Changes: Adds a thread to ContainerStorageManager to continually poll the checkpoint topic, as well as barrier conditions within TaskSideInputHandler to keep consumption of standby side inputs from continuing past the checkpointed offset.

Tests: No tests. TODO.

bkonold avatar Aug 20 '20 08:08 bkonold