modelkit icon indicating copy to clipboard operation
modelkit copied to clipboard

Be able to push assets directly from remote storage to remote storage (for s3)

Open tgenin opened this issue 3 years ago • 0 comments

Currently asset new or asset update push data from local to MODELKIT_STORAGE_PROVIDER

https://cornerstone-ondemand.github.io/modelkit/assets/managing_assets/#create-a-new-asset

which mean asset must be on local storage to be pushed

It could be interesting to be able to directly push asset from remote to remote without writing on local disk

Note: the feature seems to be partially for gcs but it just download locally to repush :

https://github.com/Cornerstone-OnDemand/modelkit/blob/6e71fe78155887fd349df4907b3633ade72d565c/modelkit/assets/cli.py#L201

(idk if it still works)

So maybe at least implement an automatic redownload + push for s3

Or better find a way to do it directly (idk if it is possible at least with 2 remotes with same credentials)

tgenin avatar Mar 31 '22 12:03 tgenin