Brandon Allard

Add an asychronous zstd stream compression class

9

## Cover letter This PR adds a new Zstd streaming interface `async_stream_zstd` that is different from the existing `stream_zstd` in a few ways. Firstly all compression/decompression methods return futures and...

[WIP] resource_mgmt: decrease fetch scheduling group shares

1

## Backports Required - [x] none - not a bug fix - [ ] none - this is a backport - [ ] none - issue does not exist in...

Improve handling of progress conditions in non-polling fetch

4

The use of `ss::when_any` and `ss::promise` for each progress condition resulted in unneeded allocations as well as expensive broken promises and exception propagation. This commit changes all progress conditions to...

Enable `smp_message_queue metrics` by default

6

These metrics were originally disabled for overloading the collectd servers many years back. However, these days they seem like a drop in the bucket relative to number of metrics seastar...

Fix high CPU usage at idle on high core count machies

3

# TLDR Sorry for the long PR message on this one. Basically at idle on a 96 core machine we were noticing CPU usage of ~85%. Being at idle there...

Allow for the topic label in metrics to be dynamically aggregated

1

This PR enables the topic label to be dynamically aggregated when topic count exceeds a configurable limit. The motivation for this is that high topic counts can currently overwhelm our...

Implement a cluster-wide max user topic count limit

5

This PR adds a cluster configuration that allows for a maximum number of user created topics to be configured and enforced. It is being enforced in `topics_frontend::do_create_topic` to ensure that...

[WIP] Reduce oversized allocation error threshold

3

Do not merge this PR. Using it to run CI with a lower oversized allocation error threshold. ## Backports Required - [x] none - not a bug fix - [...

This PR aims to get the tests in ManyTopicsTest passing in our CDT env once again. ## Backports Required - [x] none - not a bug fix - [ ]...

Add support for custom payloads to client-swarm

1

The intended use-case for this change is enabling client-swarm to produce messages that are properly formatted for a given schema on a given Iceberg topic. After this PR is merged...