ChristThePhone
ChristThePhone
It is a custom developed socket server written in C++ to service the [forward protocol](https://github.com/fluent/fluentd/wiki/Forward-Protocol-Specification-v1)
Thanks for the link to the `in_forward` plugin implementation, I will make sure my code works in a similar way, it currently reads data from the socket until the fluentd...
> If possible, can you capture and attach a series of TCP packets? Then, we may find the way to reproduce your issue. Unfortunately not, I cannot have customer systems...
Then the out_forward buffering code should check the validity of the files ? I have no indication of a problem writing files so I would not exclude the possibility that...
I will try to get my hands on a system in the failing state to see what the buffer files look like. If your theory of corrupted files is correct...
Looking at the [out_forward code](https://github.com/fluent/fluentd/blob/b4dc14dcdf9169a0224955252b468a365e5fce87/lib/fluent/plugin/out_forward.rb#L687) you provided a link for it seems that it would generate this invalid request if it failed to write the chunk to the socket -...
Was able to grab the buffer files from a failing system, put them onto a test system, and was able to reproduce the error. This is the fluentd log :...
I was able to identify a buffer file causing the issue.
[bad_buffer.zip](https://github.com/user-attachments/files/23746384/bad_buffer.zip)
Successfully ran `gzip -d -c` on the bad buffer file and fed the output into `msgpack2json` without problems. The result is a valid log event: ``` [ 1762536960, { "header":...