Claire McGinty

Results 56 comments of Claire McGinty

> Right, the version needs to be set. Can you share your error when using the newer version ? yes that's what I meant - even with version set (the...

I think a third option could be to create an Estimation trait (in the style of `EstSCollection`) wrapping around the transforms themselves, with specific implementations for different kinds of transforms...

hi! Unfortunately the Scio offering reflects the limitations of the current [BQ Storage API](https://github.com/googleapis/java-bigquerystorage/blob/d910a8903d0eed6e8a8a4b7183dc7a0f401f66da/proto-google-cloud-bigquerystorage-v1/src/main/proto/google/cloud/bigquery/storage/v1/stream.proto#L59-L64) (what Beam's BigQueryIO [uses](https://github.com/apache/beam/blob/9673d8b49a820b0995c227ea661da40922d5da03/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryStorageSourceBase.java#L125) for Storage reads): ```proto message TableReadOptions { // Names of the fields...

> Currently exiting API allow users to pass read-only IOs to write APIs which will fail at runtime. But we can do better and catch these mistakes at compile time....

come to think of it maybe we should just run `sbt mdoc` for all PRs? because if an API changes it may break existing `site` references.

@azaroui can you expand a little more on why you need temp table prefix to be configurable?

Update: the client library bug affecting extract jobs has been fixed! https://github.com/googleapis/google-cloud-java/issues/3924

@regadas If I remember right, it was due to the complexity of integrating with Beam's BigQuery sources/sinks -- Beam returned types from `google-api-services-bigquery` and a lot of the Google library...

Hi @os72! I confirmed that we (Spotify) were able to secure corporate sponsorship for protoc-jar. Can we unblock this PR?

@os72, coming back to this issue, would you be open to introducing a logging lib (slf4j or JUL) into this repo? that way we could replace some of the commented-out...