xbps icon indicating copy to clipboard operation
xbps copied to clipboard

Parallel downloads

Open ArniDagur opened this issue 6 years ago • 10 comments

This is a feature that too few package managers seem to have, as using all of the available cores on the CPU to download packages brings almost a linear speedup (e.g. 4x if you have a 4-thread CPU). Parallel downloads can also even load across multiple mirrors.

ArniDagur avatar Feb 21 '19 21:02 ArniDagur

If loading across multiple local mirrors, this makes a lot of sense.

Vaelatern avatar Feb 21 '19 21:02 Vaelatern

Eh, imho it makes more sense to run multiple parallel copies from a single mirror. You have no assurances in advance that the mirrors are consistent, but you do have an assurance of a larger threadpool in nginx.

the-maldridge avatar Feb 21 '19 21:02 the-maldridge

I came here pretty much to ask a similar thing, however, more specifically, I was wondering if it would be possible to make it so that xbps downloads packages through whatever cli downloading utility we want, such as aria2 (for parallel downloads) or wget/curl for regular downloads, the idea being that the user can then choose which download utility they like best.

Kusoneko avatar Oct 09 '20 03:10 Kusoneko

@Kusoneko

Hm, I believe this could go together with #292, since I would like to make downloads be run by a separate utility by default. It would then, potentially, be feasible to make it run with any utility. I don't know if the added complexity would be accepted, unfortunately.

ericonr avatar Oct 09 '20 04:10 ericonr

Arch's pacman (ver 6) released nearly two months ago added option for parallel downloads as well, any updates on xbps?

Animeshz avatar Jul 18 '21 07:07 Animeshz

They are two completely independent codebases, so advancements in either don't affect the other

ericonr avatar Jul 18 '21 14:07 ericonr

sounds like a good feature. it should make xbps even faster xD

elderkeltir avatar Jan 28 '22 10:01 elderkeltir

Anything new about this?

sewnie avatar Apr 14 '22 22:04 sewnie

Frankly speaking, xbps without this feature feels slow. We definitely need this feature!

ghost avatar Jun 14 '22 10:06 ghost

Still waiting.

iakuraa avatar Jul 22 '22 06:07 iakuraa