databricks-cli icon indicating copy to clipboard operation
databricks-cli copied to clipboard

databricks cli cannot access '/dbfs/databricks-datasets/'

Open ShumzZ opened this issue 6 years ago • 2 comments

In the notebook, I can use %fs ls dbfs:/ or %sh ls /dbfs/

to see the directory: databricks-datasets

However in cli, when I type databricks fs ls or dbfs ls, I cannot see the above directory. I also tried dbfs ls dbfs:/databricks-datasets/, it prompted an error message:

Error: b'{"error_code":"RESOURCE_DOES_NOT_EXIST","message":"No file or directory exists on path dbfs:/databricks-datasets/."}'

Is is due to some restrictions of CLI or did I get something wrong during the configuration?

FYI: cluster mode: standard pool: None databricks runtime version: 5.5LTS python version:3 worker type: m4.large driver type: m4.large

ShumzZ avatar Sep 01 '19 01:09 ShumzZ

Is there any fix for this?

saipraveen-a avatar Sep 19 '20 04:09 saipraveen-a

@bogdanghita-db is this a misconfigured cross-account policy or something else?

nfx avatar May 04 '22 17:05 nfx