datamon icon indicating copy to clipboard operation
datamon copied to clipboard

Speed up upload of files and have concurrency (Use sendfile/io.section reader)

Open kerneltime opened this issue 6 years ago • 1 comments

Use IO primitives within go lang to speed up upload of a large number of files into datamon.

kerneltime avatar Feb 08 '19 23:02 kerneltime

Parallel upload was fixed in https://github.com/oneconcern/datamon/pull/99 and other PRs. Keeping this open as a spike for sendfile investigation.

kerneltime avatar May 10 '19 20:05 kerneltime