fluent-bit icon indicating copy to clipboard operation
fluent-bit copied to clipboard

S3 Plugin: support for zstd compression

Open cdancy opened this issue 1 year ago • 2 comments

Piggy backing off of ISSUE 8099: we'd like to see support for zstd compression within the S3 plugin. This can result in much smaller file-part size thereby bringing down costs for workloads where there is a potential problem.

I can attempt to take on initial work here if you all think this could be done I would just need some pointers on where to get started.

Tagging some more well known developers that I've worked with and/or talked to in the past to get the conversation started:

@edsiper @patrick-stephens @PettitWesley

cdancy avatar Mar 18 '24 16:03 cdancy

I can't help with implementation I'm afraid but packaging wise make sure to update any extra dependencies required for a build of each target in the container definitions in ./packaging/distros/.

patrick-stephens avatar Mar 20 '24 12:03 patrick-stephens

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.

github-actions[bot] avatar Jun 27 '24 01:06 github-actions[bot]

This issue was closed because it has been stalled for 5 days with no activity.

github-actions[bot] avatar Jul 11 '24 01:07 github-actions[bot]

Never got the time to circle back and look into things here. Would love to have this feature though.

cdancy avatar Jul 11 '24 13:07 cdancy