renku-python icon indicating copy to clipboard operation
renku-python copied to clipboard

Update dataset files that are added from a URL

Open mohammad-alisafaee opened this issue 3 years ago • 1 comments

As a Renku user, I want renku dataset update checks for update in files that are added from a URL so that I experience a consistent UX for updating all files that are added to datasets.

Acceptance Criteria

  • renku dataset update should check for update in the downloaded files from a remote URL
  • To be discussed: Users should be able to disable this feature by using a --no-remote/--no-download/... flag
  • To be discussed: We should warn users if files that are going to be checked are large
  • To be discussed: We should add a --size-only flag to the renku dataset update command that only checks files sizes instead of a checksum.

Additional context Currently, renku dataset update checks for files that are added from git, local/external files, and imported datasets.

mohammad-alisafaee avatar Jul 14 '22 08:07 mohammad-alisafaee

See https://swiss-data-science.slack.com/archives/C02J55VMTKP/p1657634901384189

mohammad-alisafaee avatar Jul 14 '22 08:07 mohammad-alisafaee