[CORE-2841] Transforms: Start consuming from an arbitrary offset (numeric from start/end or timestamp)
This PR wires up the ability to configure the start offset of a transform at deploy time. This can be either a unix timestamp (ms since epoch) or an offset delta (+oo from start offset of -oo from end).
Includes rpk experience.
Backports Required
- [x] none - not a bug fix
- [ ] none - this is a backport
- [ ] none - issue does not exist in previous branches
- [ ] none - papercut/not impactful enough to backport
- [ ] v24.1.x
- [ ] v23.3.x
- [ ] v23.2.x
Release Notes
Improvements
- Adds the ability to start transform processing from an arbitrary offset on the input topic.
/ci-repeat 1
force push empty diff (signoff)
force push rebase dev to avoid conflicts on feature flag
force push feature flag for the new position types, minor CR changes
empty diff for commit signoff
force push make legacy_transform_offset_options struct write-only.
force push a dt test case
force push to address some CR comments on the rpk side
CI Failure is https://github.com/redpanda-data/redpanda/issues/20574 (known, unrelated)