Adem Efe Gencer

Make Cruise Control resilient against bad metadata due to recreation of same topic

1

**Summary**: In clusters, where a Kafka topic is deleted and then recreated with the same name, it is possible for Cruise Control (CC) to be stuck with a stale version...

Enforce a global cap on partition movement rate during executions (e.g. during an RF--)

3

Cruise Control provides configs to limit `concurrent_partition_movements_per_broker`, `concurrent_leader_movements`, `max.num.cluster.movements`, and byte rate of ongoing replica movements. However, it does not have a global throttling on the rate of completed partition...

Cruise Control's Concurrency Adjuster automatically sets up the inter-broker replica reassignment and leadership concurrency for executions (see https://github.com/linkedin/cruise-control/issues/1288 and https://github.com/linkedin/cruise-control/issues/1298). The current automation is based on a feedback loop that...

Cruise Control has a single gradle file for all modules. This leads to code repetition (see https://github.com/linkedin/cruise-control/pull/1477#discussion_r583331314). Cruise Control should have proper per-module gradle file.

Cruise Control generates Kafka consumers with a random substring as part of the client id. However, randomly generating the client id breaks quotas based on client ids. Also each time...

PR #1289 added support for automating replica reassignment concurrency adjustment based on broker metrics. However, a similar concurrency adjustment for intra-broker replica movements is not supported, yet. Hence, it has...

Cruise Control metrics reporter and its sampler facilitate the collection of broker- and partition-level metric samples (see [BrokerMetricSample](https://github.com/linkedin/cruise-control/blob/9135102480d0d0bb2e23642da493f6af7d468c7c/cruise-control/src/main/java/com/linkedin/kafka/cruisecontrol/monitor/sampling/holder/BrokerMetricSample.java) and [PartitionMetricSample](https://github.com/linkedin/cruise-control/blob/9135102480d0d0bb2e23642da493f6af7d468c7c/cruise-control/src/main/java/com/linkedin/kafka/cruisecontrol/monitor/sampling/holder/PartitionMetricSample.java)). While partition-level metrics are primarily used for model generation, broker-level...

Make stop_proposal_execution cancel an ongoing analyzer process

1

Currently `stop_proposal_execution` takes effect only when the execution has already started. In other words, if the user sent a `rebalance/add_broker/remove_broker` request, s/he needs to wait until 1) the analyzer generates...

Remove the use of deprecated functions and use ZooKeeperClient in CC on Kafka 2.0

1

Kafka 2.0 has deprecated a number of functions such as `KafkaConsumer#poll(long)` -- remove deprecated use-cases. Also, adopt the async `ZooKeeperClient` rather than `ZkClient`.

Thanks `Justin Kaufman` for reporting this! The REST API documentation is available on cruise-control’s GitHub page [here](https://github.com/linkedin/cruise-control/wiki/REST-APIs). While it does effectively list endpoints, methods, and query parameters, it omits any...