java-manta icon indicating copy to clipboard operation
java-manta copied to clipboard
verified publisher icon TritonDataCenter

Improve Jenkins java-manta-it job and Integration-Tests to clear residual data

Open indianwhocodes opened this issue 6 years ago • 2 comments

  • Create an optional system parameter that is used for all test run directories (eg ~~/stor/java-manta-integration-tests/uuid) . This would allow us to create that dir name in the jenkins job before execution and then to delete the directory, post a successful/unsuccessful execution.

  • Figure out a way to clean up job history and multipart upload history within the integration tests and if any files are being left over in Manta after a successful/unsucessful test run.

indianwhocodes avatar Mar 14 '19 17:03 indianwhocodes

#544 once merged will resolve this issue.

indianwhocodes avatar Jul 11 '19 18:07 indianwhocodes

This is the current "scrub" job

echo "Scrubbing jobs for user $USER_TO_SCRUB"
mls /$USER_TO_SCRUB/jobs | xargs -n1 -P4 -I{} bash -c "mrm -r /$USER_TO_SCRUB/jobs/{} && echo deleted /$USER_TO_SCRUB/jobs/{}"

echo "Scrubbing jobs-based MPUs for user $USER_TO_SCRUB"
mrm -r /$USER_TO_SCRUB/stor/.multipart-6439b444-9041-11e6-9be2-9f622f483d01/ || true

echo "Scrubbing default integration test folder for user $USER_TO_SCRUB"
mrm -r /$USER_TO_SCRUB/stor/java-manta-integration-tests/

See also MANTA-2954

cburroughs avatar Jul 11 '19 18:07 cburroughs