Dennis Huo
Dennis Huo
Sometimes it is desirable to allow a workload to produce outputs which don't match the currently defined schema in BigQuery. We should plumb through [setIgnoreUnknownValues](https://developers.google.com/resources/api-libraries/documentation/bigquery/v2/java/latest/com/google/api/services/bigquery/model/JobConfigurationLoad.html#setIgnoreUnknownValues(java.lang.Boolean)) as a settable hadoop config...
Right now `spark.eventLog.dir` gets set to a GCS path regardless of what DEFAULT_FS is set for deployment; this means if a deployment intentionally disables GCS accessibility, e.g. by removing external...
The -f/--force flag is supposed to skip all confirmation prompts, but it doesn't correctly skip the prompts for running as root or for overwriting an existing config in generate_config.