Alex Ott

Create a separate python package just for REST API functions

13

Right now the `delta-sharing` package includes dependencies on arrow, pandas, etc. and this makes it's quite heavyweight - installations requires ~50Mb, and that it's not acceptable for use cases, such...

DataSharingRestClient.list_files_in_table doesn't return version of the table

1

Right now, when you call `DataSharingRestClient.list_files_in_table` doesn't return information about version of the table for which data is returned. Of course it's possible to have a separate call to the...

deltaSharing Spark source doesn't use statistics for count operation

3

The simple code that I'm using to check sizes of the shares is timeouts because it's trying to load data, although that kind of operations could be answered directly from...

Update to work with Clojure 1.3 & other fixes

2

These changes includes: - get rid of not necessary clojure-contrib dependency - use of clj-serializer 0.1.3 that was fixed to work with clojure 1.3.0 - fix exception when as-table was...

If you interested, you can merge these changes - I've adapted your code to clojure 1.5.1 & modern contribs...

The travis-ci.org is shutting down, so it makes sense to migrate to Github Actions, or something like

Add support for Spark 3.2

13

As part of "[SPARK-35558] Optimizes for multi-quantile retrieval", Spark 3.2 changed the signature of `ApproximatePercentile.getPercentiles` function and this broke the Deequ: ``` NoSuchMethodError: org.apache.spark.sql.catalyst.expressions.aggregate.ApproximatePercentile$PercentileDigest.getPercentiles([D)[D at com.amazon.deequ.analyzers.ApproxQuantile.fromAggregationResult(ApproxQuantile.scala:84) at com.amazon.deequ.analyzers.ScanShareableAnalyzer.metricFromAggregationResult(Analyzer.scala:192) at com.amazon.deequ.analyzers.ScanShareableAnalyzer.metricFromAggregationResult$(Analyzer.scala:185)...

Update command line switches for pandoc

2

New pandoc versions don't have `--chapters` command line parameter anymore, so it doesn't execute

Better support for authentication with AAD tokens

1

This PR adds support for authentication using AAD tokens that could be obtained by different means: * using azure-cli's `az account get-access-token` * Service Principal - with client ID &...

The `get_repo_id` function [doesn't propagate underlying error message](https://github.com/databricks/databricks-cli/blob/master/databricks_cli/repos/api.py#L46), effectively hiding the reason for Repo ID not found, making it very hard to debug issues, for example, when access to workspace...