[Package Request] - librdkafka

[saxonww]

What package is missing from Amazon Linux 2023? Please describe and include package name.

librdkafka, including librdkafka, librdkafka-devel, and librdkafka-debuginfo.

Is this an update to existing package or new package request?

New request

Is this package available in Amazon Linux 2? If it is available via external sources such as EPEL, please specify.

The package is available in Amazon Linux 2. It was also part of the base repo in CentOS 7, and an older version is packaged for EPEL at https://src.fedoraproject.org/rpms/librdkafka.

Any additional information you'd like to include. (use-cases, etc)

This is an optional dependency of syslog-ng, and would be useful for #639.

[garethmarkfawcett]

We have the same issue, lack of librdkafka, including librdkafka, librdkafka-devel, and librdkafka-debuginfo on AWS Linux 2023.

This is causing us to delay migration to Amazon Linux 2023 and for us to consider using other distributions that do include this pretty common library.

[hughevans]

RUN dnf update -y && \
  dnf install -y \
  cyrus-sasl-devel \
  gcc \
  gcc-c++ \
  glibc-devel \
  libcurl-devel \
  libzstd-devel \
  make \
  openssl-devel \
  tar \
  unzip \
  wget \
  which \
  zlib-devel

RUN wget https://github.com/confluentinc/librdkafka/archive/refs/tags/v${DOCKER_LIBRDKAFKA_VERSION}.zip
RUN unzip v${DOCKER_LIBRDKAFKA_VERSION}.zip
RUN cd librdkafka-${DOCKER_LIBRDKAFKA_VERSION}/ && ./configure && make && make install

[tribunsky-kir]

+1 for the package.

I am experiencing the following problem with dnf when trying to clean up build dependencies:

Problem 1: package annobin-plugin-gcc-10.93-1.amzn2023.0.1.x86_64 from @System requires (gcc >= 11 with gcc < 12), but none of the providers can be installed
 - conflicting requests
 - problem with installed package annobin-plugin-gcc-10.93-1.amzn2023.0.1.x86_64
Problem 2: package libxcrypt-devel-4.4.33-7.amzn2023.x86_64 from @System requires glibc-devel(x86-64), but none of the providers can be installed
 - conflicting requests
 - problem with installed package libxcrypt-devel-4.4.33-7.amzn2023.x86_64
Problem 3: package zip-3.0-28.amzn2023.0.2.x86_64 from @System requires unzip, but none of the providers can be installed
 - conflicting requests
 - problem with installed package zip-3.0-28.amzn2023.0.2.x86_64

My Dockerfile:

FROM public.ecr.aws/lambda/python:3.13

ENV BUILD_DEPS="cyrus-sasl-devel gcc gcc-c++ glibc-devel libcurl-devel libzstd-devel make openssl-devel tar unzip wget which zlib-devel"
ENV LIBRDKAFKA_VERSION=2.6.1

RUN dnf makecache && \
    dnf install -y ${BUILD_DEPS} && \
    wget https://github.com/confluentinc/librdkafka/archive/refs/tags/v${LIBRDKAFKA_VERSION}.zip && \
    unzip v${LIBRDKAFKA_VERSION}.zip && \
    cd librdkafka-${LIBRDKAFKA_VERSION}/ &&\
    ./configure && \
    make && \
    make install && \
    cd ../ && \
    rm -rf librdkafka-${LIBRDKAFKA_VERSION}/ v${LIBRDKAFKA_VERSION}.zip && \
    dnf remove -y ${BUILD_DEPS} && \
    dnf clean all