mpifileutils icon indicating copy to clipboard operation
mpifileutils copied to clipboard

O_DIRECT on lscratchrza (LLNL)

Open dsikich opened this issue 8 years ago • 3 comments

dcp --synchronous option is not working on lscratchrza (that we know of so far). When this option is turned on lscratchrza we need to fix the alignment and sizes.

dsikich avatar Oct 12 '17 00:10 dsikich

For now the options are: run dcp then dcmp to check src matches dest directory run an srun --drop-caches after running dcp (LLNL)

dsikich avatar Oct 12 '17 01:10 dsikich

You should be able to get the block size of a file by performing a stat on it. Once you do that, you should be able to allocate a buffer of that size. This will likely complicate how files are split up in dcp I imagine.

dinatale2 avatar Oct 16 '17 18:10 dinatale2

Isn't the root of the problem here that ZFS does not support O_DIRECT in 0.7.x (though fixed in 0.8.x)?

adilger avatar Jul 03 '19 15:07 adilger