BigQuery Sharded Tables

[Sgiostra-BitBang]

There is a feature in Dataform that allow to use Sharded Tables as source?

[bigrogerio]

Great question. But why not partitioning instead sharding? I think sharding is not the best practice in BigQuery nowadays, IMO.

I have worked with sharded tables with Analytics 360. but i think that it's outdated now.

With partitioning, you can have up to 4000 partitions, whereas when you query date sharded tables, you can only query up to 1000 tables at once.

Best regards.

[astorrs]

Yes you can do this: https://github.com/dataform-co/dataform/discussions/1496