Martin

[Feature Request] Set userId, userName, notebook, clusterId in delta history

2

## Feature request ### Overview [Delta History schema](https://docs.delta.io/latest/delta-utility.html#history-schema) features some attributes that are always NULL for me (Delta Lake 1.1 Spark 3.1): - userId - userName - notebook - clusterId...

[Feature Request] Make OPTIMIZE ZORDER BY skip partitions selectively if the most recent version was already optimized

14

## Feature request ### Overview OPTIMIZE ZODER BY let users influence the order of rows in the persisted parquet files allowing _data skipping_ on read. Currently every time it is...

## Bug #### Which Delta project/connector is this regarding? - [X] Spark - [ ] Standalone - [ ] Flink - [ ] Kernel - [ ] Other (fill in...

[Feature Request] documentation of Delta configs / table properties missing (e.g. `checkpointInterval`, `enableDeletionVectors`, `enableExpiredLogCleanup`)

3

## Feature request ### Overview Official [Delta table properties reference](https://docs.delta.io/latest/table-properties.html#delta-table-properties-reference) is missing lots of [implemented delta configs](https://github.com/delta-io/delta/blob/master/core/src/main/scala/org/apache/spark/sql/delta/DeltaConfig.scala). For example: - `checkpointInterval` - `enableExpiredLogCleanup` - `enableDeletionVectors` - `enableFullRetentionRollback` - `enableRowIds` I...

Add RSS/Atom feed to Delta Lake Blog (`delta.io/blog`)

2

I think it would be great if the [Delta Lake blog](https://delta.io/blog) would also support a [RSS](https://en.wikipedia.org/wiki/RSS)/[Atom](https://en.wikipedia.org/wiki/Atom_(web_standard)) feed. This way I could get notified more easily if there are new articles.

Parquet Preview: human readable `timestamp` and `date` values

11

### Preflight Checklist - [X] I have installed the [latest version of Storage Explorer](https://github.com/Microsoft/AzureStorageExplorer/releases/latest). - [X] I have checked existing resources, including the [troubleshooting guide](https://docs.microsoft.com/azure/storage/common/storage-explorer-troubleshooting) and the [release notes](https://github.com/microsoft/AzureStorageExplorer/releases). -...

Column Lineage doesn't work properly for Spark StructType columns

9

# Context Spark / Spark SQL supportes _nested_ datatypes. So called [`StructType`](https://docs.databricks.com/sql/language-manual/data-types/struct-type.html) are basically a _container_ for other attributes. So a schema of a Spark Table/View is not necessary a...

Hi, I have the situation where there are **SQLFluff problem marked in the editor window** but which do not correspond to the results when executing SQLFluff from terminal. I also...

Hi, I have a Delta table where [column mapping](https://docs.delta.io/latest/delta-column-mapping.html) is enabled (`minReaderVersion=2`, `minWriterVersion=5`). There is a reading application that does not understand that feature / protocol yet, so I thought...

[Feature Request] optimize `COUNT(*)` on partitioned tables

4

## Feature request Running the query `SELECT COUNT(*) FROM table WHERE partition_column = 1` should only read Delta log statistics. @felipepessoto https://github.com/delta-io/delta/issues/1192 / https://github.com/delta-io/delta/commit/0c349da8 already introduced this feature for `SELECT...