Eric Marnadi

icon company Databricks icon location Bellevue, Washington

Results 4 comments of Eric Marnadi

[SPARK-51955] Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

@anishshri-db @liviazhu-db Sure yeah sounds good

[SPARK-51955] Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

cc @cloud-fan

[SPARK-51955] Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

> Looks good! Could you add a test in StateStoreRDDSuite to check the ThreadLocal logic correctly passes the readstore to the writestore too? Yup, working on that rn!

[BUG] Data loss and data duplication when the Pulsar reader experiences network connectivity issues

Addressing this here: https://github.com/streamnative/pulsar-spark/pull/180