Hao Geng
Hao Geng
There are multiple goals in cruise-control that could provide OVER_PROVISIONED as the ProvisionStatus. After all goals are optimized, there will be an aggregated ProvisionStatus. It is expected that the aggregated...
As a support of the BrokerSetAwareGoal, we may want to show the brokerSet id of each topic in the kafka_cluster_state.
Recently AWS has make contributions to CC and create this BrokerSetAwareGoal in: https://github.com/linkedin/cruise-control/pull/1809. This goal will ensure each topic (all its partitions and replicas) only lives within a single broker...
`2022/07/27 17:10:02.732 INFO [ExecutionUtils] [ProposalExecutor-0] [kafka-cruise-control] [] Found tasks to re-execute: [{EXE_ID: 1543145, INTER_BROKER_REPLICA_ACTION, {partitionA , oldLeader: 44256, [44604, 44256, 35438] -> [44604, 44256, 35438]}, IN_PROGRESS} while detected in-movement partitions:...
This PR resolves #1862 . As in the issue described, there are 2 solutions: 1. Make this goal easily extendable, and users can create a new goal reusing the code...
When ReplicaDistributionGoal run rebalanceByMovingReplicasIn and rebalanceByMovingReplicasOut method, it could fail to complete in the following 2 conditions: 1. Run out of time within the fast_mode time limit 2. No more...
In a recent debugging process, a very interesting issue is discovered: In https://github.com/linkedin/cruise-control/blob/3f379efee313c035d18b64c0157af1fe48f2cab4/cruise-control/src/main/java/com/linkedin/kafka/cruisecontrol/analyzer/goals/ReplicaDistributionGoal.java#L272, CC removes the broker from candidate broker TreeSet, and re-insert it, to maintain the correct order inside...
Exception is: `java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidReplicaAssignmentException: Inconsistent replication factor between partitions, partition 0 has 3 while partitions [58, 59, 60, 61, 62, 63, 64, 65, 66, 67] have replication factors [4, 4,...
Today the way Cruise Control determine whether a partition is offline, is to check whether ISR set is empty: https://github.com/linkedin/cruise-control/blob/a8a190f7c4662e1fc742994792c75b108fd9064d/cruise-control/src/main/java/com/linkedin/kafka/cruisecontrol/servlet/response/ClusterPartitionState.java#L105 While this works correctly for most of the time, it's...
Hi CC community, we would like to announce that we will deprecate _migrate_to_kafka_2_4_ branch from today. Here are some action items: - Please update your CC version to 2.5.*. We...