dataform-scd

dataform-scd copied to clipboard

Hash value comparison: new record is not loaded, if the same hash value exist in older record.

5

When using hash value comparison, new record is not loaded, if the same hash value exist in older record. Input data: CUSTOMER_ID | CUSTOMER_ADDRESS | UPDATE_ON|Comment -- | -- |...

nnikolov84

Updates table will create "blind spots" between creation and update times

3

This is an issue occurs both when backfilling records (when deploying the SCD script for the first time) and when adding new records with no entries on the updates table...

mhsnook

Bumps [protobufjs](https://github.com/protobufjs/protobuf.js) from 6.9.0 to 6.11.3. Release notes Sourced from protobufjs's releases. v6.11.3 6.11.3 (2022-05-20) Bug Fixes deps: use eslint 8.x (#1728) (a8681ce) do not let setProperty change the prototype...

dependabot[bot]

Handling new insertion on existing SCD table

1

The SCD library doesn't seems working on handling new rows (insertion). For example: Existing source table has rows with id : 1,2,3 After initial Dataform run The table_scd_updates has rows...

adiwijaya

I noticed that the "_update" table would never be re-created once it has been build in the first time, Even when I execute the dataform pipeline and selecting fresh rebuild...

ahmedloai

The current implementation of the Dataform SCD package only captures new or updated records based on last_updated_time. However, it does not handle deleted records, causing previously existing rows to remain...

traychomilevdriven