Akshay Rawat

icon indicating an email [email protected]

icon company AWS icon location National Capital Region ( Delhi ) , India

Results 3 issues of Akshay Rawat

Changes to make the library work on EMR on EKS Fargate.

The PR closes https://github.com/qubole/kinesis-sql/issues/111

The library does not work with EMR on EKS Fargate | Infinite Loop

I was trying to connect to Kinesis stream from a Spark streaming job running on EME on EKS on a Fargate container. The code snippet I tried is following -...

Do I have to restart the Spark streaming job for new schema to take effect ?

9 comment

I was trying Abris library and consuming CDC record generated by Debezium. ``` val abrisConfig: FromAvroConfig = (AbrisConfig .fromConfluentAvro .downloadReaderSchemaByLatestVersion .andTopicNameStrategy(topicName) .usingSchemaRegistry(schemaRegistryURL)) val df=(spark .readStream .format("kafka") .option("kafka.bootstrap.servers", brokerServers) .option("subscribe", topicName)...