iceberg icon indicating copy to clipboard operation
iceberg copied to clipboard

Improve manifest caching to be read-through instead of read-ahead

Open rizaon opened this issue 3 years ago • 0 comments

Feature Request / Improvement

PR #4518 implement manifest content caching by reading the InputFile's stream ahead, loading it to cache, and serve the cached List<ByteBuffers> to reader. If this is merged, we can improve it further by making it read-through instead of read-ahead so that reader is not blocked initially to load the cache.

Query engine

No response

rizaon avatar Sep 21 '22 07:09 rizaon