yzhou2001

Google Cloud Write Channel Creation does not have the BackOff retries…

5

Google Cloud Write Channel Creation does not have the BackOff retries #142

Got the following stack from HBase server: ``` 2018-12-13 21:55:07,502 ERROR [gcs-async-channel-pool-29] util.AbstractGoogleAsyncWriteChannel: Exception not convertible into handled response com.google.cloud.hadoop.repackaged.gcs.com.google.api.client.googleapis.json.GoogleJsonResponseException: 500 Internal Server Error { "code" : 500, "errors" :...

globStatus call runs very slowly from Hadoop to GCS compared with gsutil

3

Run a glob listing on a big tree of around 890K entries. 1. Using Hadoop: ```bash hadoop fs -ls gs://bucketabc/1???/1/1/small-1.txt ``` takes 3+ minutes; 2. Using Spark ```scala spark.read.format("com.databricks.spark.csv") .option("header",...