renku-python
renku-python copied to clipboard
Update dataset files that are added from a URL
As a Renku user, I want renku dataset update checks for update in files that are added from a URL so that I experience a consistent UX for updating all files that are added to datasets.
Acceptance Criteria
-
renku dataset updateshould check for update in the downloaded files from a remote URL - To be discussed: Users should be able to disable this feature by using a
--no-remote/--no-download/... flag - To be discussed: We should warn users if files that are going to be checked are large
- To be discussed: We should add a
--size-onlyflag to therenku dataset updatecommand that only checks files sizes instead of a checksum.
Additional context
Currently, renku dataset update checks for files that are added from git, local/external files, and imported datasets.
See https://swiss-data-science.slack.com/archives/C02J55VMTKP/p1657634901384189