Jonas Borgström
Jonas Borgström
Did you try to simply leave the directory entries unsorted? os.listdir() returns entries in "arbitrary order" which probably means that the entries probably already are in inode order due to...
Since it seems to require a very large amount of data to trigger this and nobody else seems able to reproduce it, it's not that unlikely that this could be...
Is POSIX_FADV_DONTNEED really what we want? Just because we know that we will not need a specific piece of data again it is not our business to tell the kernel...
> Rsync does use fadvise. This page seems relevant: http://insights.oetiker.ch/linux/fadvise.html This page seems to talk about a _patch_ for rsync. Has this been accepted upstream?
> I use encryption for the backup but tried a repo without encryption. I even tried backing up from one internal drive to an other. Still get the same speed....
Ok, so the cpu is not the bottleneck... Are you able to try the GIT version which includes some performance improvements?
Weird, I can't really understand what's stopping Attic from using 100% of the cpu when we know that the disk io is fast enough (at least when using zip). Here's...