is there a Pyspark example for writing rdd to redis, i'm getting error while importing the import com.redislabs.provider.redis._

Open SrinivasanNagarajaRao opened this issue 5 years ago • 2 comments

Dec 16 '20 16:12 SrinivasanNagarajaRao

Try the Dataframe API.

You won't be able to import anything from this library into pyspark since there is no python library to import.

The Dataframe API or Spark SQL should still work. Follow this https://github.com/RedisLabs/spark-redis/blob/master/doc/dataframe.md, but instead of scala, write similar in python. Do ensure that the spark-redis package or jar is included.

Dec 16 '20 17:12 mayankasthana

but how do these guys doing it on. https://support.huaweicloud.com/intl/en-us/devg-dli/dli_09_0097.html https://support.huaweicloud.com/intl/en-us/devg-dli/dli_09_0094.html

Dec 16 '20 19:12 SrinivasanNagarajaRao