AzureStor icon indicating copy to clipboard operation
AzureStor copied to clipboard

storage_load_rds gives error due to memory while download and then read_rds works

Open vidarsumo opened this issue 3 years ago • 0 comments

Is there a reason for this? I cannot use storage_load_rds() on a VM with 256 GB of RAM but I can download the file and read it in using read_rds().

> full_mtbl <- storage_load_rds(azure_connection$container_dev_model, "path_to_model.rds")
  |========================================================================================================================================================================================| 100%
Error: cannot allocate vector of size 3.9 Gb

> storage_download(azure_connection$container_dev_model, "path_to_model.rds")
  |========================================================================================================================================================================================| 100%
> full_mtbl <- read_rds("model.rds")

vidarsumo avatar Mar 15 '22 09:03 vidarsumo