Alexander Fedulov
Alexander Fedulov
I need this! @jxnblk How about merging the PR?
I would really appreciate if someone could maybe provide some insights into how to workaround this limitation.
Thanks @jethrokuan. The file got truncated. Any idea why this could happen when the disk gets full?
@zentol I addressed your comments, could you please take a look?
@zentol the latest three commits address the main open discussion threads: - DataGeneratorSource is moved into a separate connector module - RateLimiterStrategy is added - SourceReaderFactory-based constructor is sealed PTAL....
@zentol, thanks for the quick feedback. I addressed your comments.
> Tried it out in some internal projects and it worked like charm. :heart: Perfect, glad to hear! :clap: > Should we deprecate the existing DataGeneratorSource in flink-streaming-java? Good question....
I guess the FLIP also needs an update according to some interface changes that took place.
>Looks like the DataGenTableSource may use the stateful SequenceGenerator (DataGenTableSourceFactory#createContainer)?. Oh, indeed, missed that one. However, it looks like the stateful property of the generated sequences is already covered by...
@zentol I added the docs. Not 100% sure if the last bit about per-checkpoint generation is relevant enough for the general public. I am open to drop it if you...