AzureStorageExplorer
AzureStorageExplorer copied to clipboard
Parquet Preview: Add support for Delta Encoding
Preflight Checklist
- [X] I have installed the latest version of Storage Explorer.
- [X] I have checked existing resources, including the troubleshooting guide and the release notes.
- [X] I have searched for similar issues.
Problem
I'm unable to preview Parquet files created with delta encoded numbers. When trying to preview such a file, I get the error message "invalid encoding: DELTA_BINARY_PACKED".
Desired Solution
Preview of Parquet files with delta encoded numbers should be possible.
Alternatives and Workarounds
No response
Additional Context
No response
@JasonYeMSFT please determine if the parquet-js library needs modification to support delta encoding. If so, then open an issue and we can triage this into near future. If instead supporting delta encoding only requires work on our side, please provide a cost estimation for that work so we can triage into a milestone.