jtuglu1

Results 16 issues of jtuglu1

Allows the scaler to scale up to the nearest divisor of the partition count. This helps support even distribution of partitions across tasks, lowering total lag across the supervisor. Computes/caches...

Area - Streaming Ingestion
Area - Ingestion

This is the first part of a 2-part PR set which aims to emit better metrics on per-query caching decisions (both result level and segment level). If the result level...

Area - Documentation

Druid can struggle with query fairness in the native engine at the data node level (peon, historical). ### Background There are N primary “resources” which queries contend over during query...

Performance
Area - Querying
Area - Ingestion

Follow-up to https://github.com/apache/druid/pull/18082. ### Description Updates the supervisor view UI to include the `datasource` column in the `sys.supervisors` table, as well as ensures the `id` field in the root of...

Area - Web Console

### Description I'm currently building support for ingesting from multiple kafka clusters simultaneously in the same datasource/supervisor (e.g have multiple consumer/broker pairs). This issue is for marking this feature as...

Feature/Change Description

Fixes #XXXX. ### Description #### Fixed the bug ... #### Renamed the class ... #### Added a forbidden-apis entry ... #### Release note ##### Key changed/added classes in this PR...

Area - Ingestion

### Description Still a draft. I've seen on the giant lock in `HttpRemoteTaskRunner` cause severe performance degradation under heavy load(200-500ms per acquisition with 1000s of activeTasks can slow down the...

Area - Ingestion

Fixes [#18764.](https://github.com/apache/druid/issues/18764) ### Description #### Race Segment load/drop callbacks are racing with [prepareCurrentServers](https://github.com/apache/druid/blob/master/server/src/main/java/org/apache/druid/server/coordinator/duty/PrepareBalancerAndLoadQueues.java#L139-L147). Consider the following scenario: Coordinator is moving segment `S` from server `A` to server `B`. `S` has...

### Motivation Currently, Druid can serve partial result sets unbeknownst to the user. This can occur due to many reasons: - Data node crash/failure/unavailability - Broker missing announcements from historicals/realtime...

Bug
Area - Querying
Design Review
Proposal

I've identified a race in segment movement which causes temporary segment unavailability (and thus partial query results). Segment load/drop callbacks are racing with [prepareCurrentServers](https://github.com/apache/druid/blob/master/server/src/main/java/org/apache/druid/server/coordinator/duty/PrepareBalancerAndLoadQueues.java#L139-L147). Consider the following scenario: Coordinator is...

Bug
Area - Segment Balancing/Coordination