datalake
datalake copied to clipboard
a metadata-aware file archive
Initial commit for upgrading the 'latest' functionality of datalake. This PR is specifically for the updates to the ingester.storage file and associated tests. **Note** this PR is written for boto2....
* switch the short option for --storage-url from -u to -U, since --http-url takes precedence for -u already * Fix test client/test/test_archive.py::test_push_large_file
Previously we were pinned to an older version, and didn't include the queuable extra required for the datalake uploader.