databricks fs cp -r Command Fails with INTERNAL_ERROR When Copying Files from DBFS

[gtatiya]

I am encountering an issue with the databricks fs cp -r command when trying to copy files from DBFS to my local file system. The command used to work fine, but now it fails with the following error:

Error: b'{"error_code":"INTERNAL_ERROR","message":"Unexpected error."}'

Steps to Reproduce: Run the following command in the Windows Command Prompt: databricks fs cp -r "dbfs:/mnt/publishers" "C:\Users\rank_publishers"

Additional Information: I have tried re-installing the Databricks CLI, but the issue persists. I have enabled debug logging using set DATABRICKS_DEBUG=true, but the error message remains the same. The DBFS path and local directory are correct and accessible.

Environment: Databricks CLI version: Version 0.18.0 Operating System: Windows 10