Mark Pevec

ElasticsearchIO template improvements

1

switch create to index to allow duplicates (due to timeout/retry) to not cause errors + add javascript functions for extraction of id, index, type, and whether or not to delete...

New template for Spanner changestreams to Elasticsearch

1

Resolves issue #413

[Bug]: ElasticsearchIO templates don't respect retry parameters in common scenario

2

### Related Template(s) BigQueryToElasticsearch, GCSToElasticsearch, PubsubToElasticsearch ### What happened? When running these templates against a busy Elasticsearch cluster it is common to encounter request timeout errors (because the busy ES...

Provide way to extract _id for indexed document in templates that write to Elasticsearch from index document fields

3

### Related Template(s) BigQueryToElasticsearch ### What feature(s) are you requesting? When using this template to index it auto-generates indexed document _id values. This makes it difficult to be able to...

Closes: https://github.com/GoogleCloudPlatform/DataflowTemplates/issues/397

[Bug]: ElasticsearchIO does not properly respect getMaxBatchSizeBytes option

2

### Related Template(s) BigQueryToElasticsearch, GCSToElasticsearch, PubsubToElasticsearch ### What happened? when setting a max batch size bytes option that value is not respected and some batches can be larger. This is...

[Bug]: Build error for DatastoreToPubsub

1

### Related Template(s) DatastoreToPubsub ### What happened? tried to build the template with the command: ``` mvn compile exec:java -Dexec.mainClass=com.google.cloud.teleport.templates.DatastoreToPubsub -Dexec.cleanupDaemonThreads=false -Dexec.args=" \ --project=tealbook-dev --stagingLocation=gs://tealbook-dev-dataflow/staging --tempLocation=gs://tealbook-dev-dataflow/temp --templateLocation=gs://tealbook-dev-dataflow/templates/DatastoreToPubsub.json --runner=DataflowRunner" ``` and...

Thanks for stopping by to let us know something could be better! **PLEASE READ**: If you have a support contract with Google, please create an issue in the [support console](https://cloud.google.com/support/)...

Strange issue: it seems to work ok on some macs with the latest Xamarin Studio (5.9.4 build 5), but on one mac it gives “Error adding to project: Cannot get...

New Spanner query results to Elasticsearch (batch) template

1

Resolves #456