zstd icon indicating copy to clipboard operation
zstd copied to clipboard

Allow files bigger than 2GiB for --patch-from option

Open JuniorJPDJ opened this issue 2 years ago • 3 comments

This is very crucial for my usecase to have patches for files bigger than 2GiB. I'm trying to find suitable open-source and supported smv alternative as I've a big collection of files very similar to each other (100M patches on >5GiB files). Is it hard to allow dictionaries larger than 2GiB? (As I suspect this is the limitation reason). AFAIK 2 gigs is signed int size limit.

JuniorJPDJ avatar Dec 25 '23 00:12 JuniorJPDJ

Indeed, it's a non trivial patch. And a non-trivial validation stage, to ensure no regression for existing use cases.

Cyan4973 avatar Dec 25 '23 00:12 Cyan4973

We have the same problem. Is there a plan to support this?

cantalou avatar Jan 18 '24 09:01 cantalou

+1 for this, --patch-from is truly amazing, but lack of support for >2GiB is a problem for me.

dbregman avatar May 02 '24 18:05 dbregman