Compatible File storage provider that do not support signature with trailer

[fcfangcc]

Feature Request / Improvement

When use fsspec io-impl, put object to File Storage Provider(FSP) not support

• Signature calculations for trailing headers

• checking-object-integrity-upload

Put file like snapxxx.avro will not handle by FSP after upload(put object is success), the file some data signature related things are reserved.

When get snapxxx.avro to read and decoder, raise Error, Because the file contains signature information

  File "pyiceberg/avro/decoder_fast.pyx", line 150, in pyiceberg.avro.decoder_fast.CythonBinaryDecoder.read_utf8
    cpdef str read_utf8(self):
  File "pyiceberg/avro/decoder_fast.pyx", line 156, in pyiceberg.avro.decoder_fast.CythonBinaryDecoder.read_utf8
    return self.read_bytes().decode("utf-8")
  File "pyiceberg/avro/decoder_fast.pyx", line 130, in pyiceberg.avro.decoder_fast.CythonBinaryDecoder.read_bytes
    return r[0:length]
SystemError: Negative size passed to PyBytes_FromStringAndSize

[fcfangcc]

I didn't find any config to ture off it from the aiobotocore document.

I try monkey patch, it can changed aiobotocore behavior and work ok 🐶

from aiobotocore import httpchecksum
httpchecksum.apply_request_checksum = lambda *args, **kwargs: None

Does anyone know how to ture it off.