JF Chen

list index out of range error in query connection

2

When I execute a sql query in orator, it throw out folling error ``` Traceback (most recent call last): File "C:\Anaconda3\lib\site-packages\orator\connections\connection.py", line 32, in _run result = wrapped(self, query, bindings,...

How to create LuceneRDD in Java?

1

It seems really helpful to me. But when I try to use it in Java, like initiate with new `LuceneRDD(df.RDD())` in java, it seems need some other arguments, such as...

Is there any demo for compress streaming data?

10

I have read this article https://github.com/lz4/lz4/blob/dev/doc/lz4_Frame_format.md and it looks quite suitable for me to compress continous incoming data and append them into compressed local file. But unfortuanately I cannot found...

Does Spark tf connect support in memory transform?

1

I have a lot of data in parquet format on hdfs, which I want to use for tensorflow. Currently, I can read parquet files into spark and output the dataframe...

Can't download platform-tools/ADB from China

10

When I click the install button in the app, it shows "Downloading" for a while, then the app closes by itself. When I open the app again, it prompts me...

Can it work with Spark SQL directly?

6

I mean the SQL language in Spark SQL, rather than spark sql api. For example: Dataset sqlDF = spark.sql("SELECT * FROM parquet.`examples/src/main/resources/users.parquet`");

buffer_size must be greater than zero error when use custom dataset

1

When I use my custom dataset to train model from scratch, it output the error: > WARNING:tensorflow:`tf.keras.callbacks.experimental.BackupAndRestore` endpoint is deprecated and will be removed in a future release. Please use...

Auto generate the yaml file including the class id and class name. The train and val folders are set to : ``` train: images/train val: images/val ``` by default. ##...

I output some snappy file with SnappyHadoopCompatibleOutputStream, which may used by both hadoop and normal java application. However, the hadoop snappy codec requires a native snappy library, which doesn't support...

How to make existed snappy compressed file compatible with hadoop?

3

I have output some snappy compressed file, and I need to read them via Spark. It seems the snappy file made by SnappyFramedOutputStream cannot be read by hadoop. So can...