apache-spark-node icon indicating copy to clipboard operation
apache-spark-node copied to clipboard

Streaming support from kafka ?

Open sudharshanPLT opened this issue 9 years ago • 1 comments

Hi, I have an use case where my spark code has to read streaming data from kafka and perform some business logic and write it to HDFS. My entire business logic is currently in node.js. Does this repo supports this use case ? I also see that the examples described are in interactive mode with spark-node, on similar lines how can i run my java script code via spark-submit ?

sudharshanPLT avatar Dec 29 '16 19:12 sudharshanPLT

Hi. Any luck with your Node.js Spark project and Kafka?

I am applying for a job and I think they are doing something similar, so trying to learn up coming from the Node.js side (with small bit of Spark/MapReduce experience).

theoxylo avatar Feb 05 '17 19:02 theoxylo