m09526

Rust compaction

1

THIS IS AN EXPERIMENTAL PR. NOT READY FOR MERGE. ### Issue Resolves 1359 ### Tests Rust compaction units tests not present yet.

### Background We want to evaluate the performance of recent improvements to Nvidia RAPIDS library on data compactions in Sleeper. ### Description Re-implement data compactions using a GPU based algorithm...

This is the draft implementation for review of adding simple ageoff filtering and very simple min, max, count, sum aggregation. I've opened this for review of the current work before...

### Background Following on from #4344 , we would like to support aggregation of map columns in DataFusion. For example, given | Key |Total | Items | |--|--|--| | a...

Discussion: Design for experimental aggregation support in DataFusion compactions

2

# Background To progress beyond "experimental" status, the DataFusion compaction library in Sleeper must be able to perform the function of "iterators" on in the Java codebase. The most important...

We currently have getting started documentation as well as detailed ingest guides and query guides and deployment guides with multiple options. As a new user with zero presumed knowledge, I...

Deploying a Sleeper instance, then tearing it down sometimes leaves resources behind. When re-deploying an instance of the same ID, we would expect it to work. However, CDK will often...