[Feature] Reduce S3 API calls

[polyzos]

Search before asking

• [X] I searched in the issues and found nothing similar.

Motivation

Overall Apache Paimon offers low TCO, but in terms of S3 API calls it makes way more compared to Iceberg. Using version 0.7 you can see the following in the screenshot

On the left it's the S3 API calls Apache Iceberg makes and on the right its Apache Paimon (~3k/hour I believe)

I believe @JingsongLi mentioned some improvements were made in the upcoming 08 version, but as this is important for many companies we need to keep it as low as iceberg if possible.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

• [ ] I'm willing to submit a PR!