blindspotbounty

ByteBuffer.withUnsafeReadableBytes does not accept async closures

4

I haven't found a template for feature request, improvement or question, thus adding it as blank one. Recently, there is `NIOAsyncChannel` was added to swift-nio. It is very convenient to...

[swift] distinguish unknown from absent enum value for scheme evolution

6

We discovered that on enum scheme evolution we cannot distinguish absent value from unknown one. There is an example of scheme evolution. First version: ``` /// enums_v1.fbs namespace EnumUnknown; enum...

fix double free for hdrs (pass ownership to message)

4

Fixes double free for hdrs variable, more info here: https://github.com/confluentinc/librdkafka/issues/4627 Rare case when try to send message for non-existing topic/server etc.

rd_kafka_produceva: double free headers on message sending error

2

Description =========== Accidentally, we found a problem related to headers double free in `rd_kafka_produceva` method: ``` ================================================================= ==49557==ERROR: AddressSanitizer: heap-use-after-free on address 0x0001178e9dd8 at pc 0x00010f6813b4 bp 0x00016b719000 sp 0x00016b718ff8...

Currently there is a workaround with sleeps and pollIntervals: https://github.com/swift-server/swift-kafka-client/pull/158/files#diff-8ba8c17c39d40fc29ec22c104d01bacc928df36e717000547f2a97d4203ef6a1R93 We have to fix that when [implemented](https://github.com/apple/swift-evolution/blob/main/proposals/0417-task-executor-preference.md)

Crash when sending message with headers

1

For some situations, headers could be freed by librdkafka thus leading to crash: ``` Thread 5 Queue : com.apple.root.user-initiated-qos.cooperative (concurrent) #0 0x0000000189d4d11c in __pthread_kill () #1 0x0000000189d84cc0 in pthread_kill ()...

Duplicated messages when default rebalance happening with 2+ consumers and offset auto commit disabled

2

Currently, swift-kafka-client does not support rebalance callback/event. However, that is pretty important thing to avoid duplicated messages from the broker. The typical scenario for a lot of applications is to...

According to proposal https://github.com/apple/swift-evolution/blob/main/proposals/0331-remove-sendable-from-unsafepointer.md OpaquePointer is no longer Sendable (also [comment](https://github.com/apple/swift/issues/70396#issuecomment-1851497237)) Let's fix that by wrapping it or by setting `@unchecked Sendable`

Consumer performance benchmark

5

This PR addresses the need of performance measurements for #132 ## Motivation Reading messages with swift-kafka-client KafkaConsumer is up to 50x slower than librdkafka allows. The following results with 500000...

Sometimes it is required to know topics registered on broker and number of partitions, replicas per topic. librdkafka has method `rd_kafka_metadata(...)` to provide such information. Would be nice to be...