fluent-bit-go icon indicating copy to clipboard operation
fluent-bit-go copied to clipboard

Add support for filter plugins

Open theMagicalKarp opened this issue 5 years ago • 3 comments

theMagicalKarp avatar May 28 '20 15:05 theMagicalKarp

why do you need Go filters ?

Actually the context transition from C -> Go runtime is very expensive, filtering needs to happen as fast as possible, we offer Lua for filtering which is really fast. Is there anything that Lua cannot offer but can be done in Go ?

edsiper avatar May 28 '20 15:05 edsiper

I'd like to switch to fluent-bit and port our internal fluentd filter plugins.

In my opinion, It's more a matter of convenience than performance. The teams I work on are a lot more comfortable with using Go over C or Lua. (Which is what I thought the purpose of this repo was?)

When you say it's expensive, can you explain why that is? What's the order of magnitude?

Also seems like this is dependent on this change. https://github.com/fluent/fluent-bit/pull/1277

theMagicalKarp avatar May 28 '20 16:05 theMagicalKarp

I think WASM support will cover this case. Compile your Go to WASM and you're good to Go ;)

ericmillin avatar Jan 11 '22 13:01 ericmillin