Daniel Tomes

Results 136 issues of Daniel Tomes

Extension to #321 When using an api like the one below, the only supported method to write metadata is through the use of the sparkSession which works until a single...

enhancement
good first issue

When the dbutils namespace was highjacked and compiled the `apiToken.get` doesn't work, with the maven compiled version of the code following the build instructions. It seems like it should work...

bug

Optional description should be added for Rule and RuleSet This would allow groups wanting to describe the purposes of more complex rules the ability to do so. The description should...

enhancement

Given the rule, some anomalous data could be allowed. Assume a DF with 100 million records, does 1 record out of bounds by 0.0001 % fail the entire test? User...

enhancement

[Breeze](https://breeze.github.io/doc-java-hib/) -- Behavior based framework [Gherkin/Cucumber](https://cucumber.io/docs/gherkin/)

enhancement

The integration of other packages will enable additional patterns to work with the Rules Engine. Ultimately, these are expected to be encoded into expectations/rules but this will alleviate the switching...

enhancement

closes #342 closes #411 closes #445

Some scenarios are not yet supported and they should be noted in the docs. These include: * DLT costs for jobruns * cancelled tasks for jobRuns (pending update to DBR)...

documentation

Unfortunately, there's a bug in verifyMinimumSchema when verifying `struct`. Example field field is `jobs_snapshot_bronze.settings.job_clusters`. Below is a test case. The issue is that the bottom layer array fields are being...

bug

jobs recently received a feature that enables tagging on the job. job tags should be converted to map throughout the pipelines and surface in gold layer in the job (and...

enhancement