databricks-vscode icon indicating copy to clipboard operation
databricks-vscode copied to clipboard

Add support for interactive cell executions in ipynb notebooks on a remote cluster

Open JinwooMcLee opened this issue 2 years ago • 11 comments

First of all, thank you for great extension. Our team needed this extension to make our software engineering better with databricks.

But as our data scientists struggle with making codes neat within ipynb without IDEs, it would be really great if we have support for interactive ipynb execution attached to databricks cluster.

Do you have plans for it?

JinwooMcLee avatar Feb 17 '23 02:02 JinwooMcLee

Support for cell based execution in ipynb notebooks is something we want to look into once we integrate with DBConnect v2.

Keeping this ticket open to track progress in the future.

Please upvote if you would like to see this feature.

fjakobs avatar Feb 17 '23 10:02 fjakobs

Upvote!

chrysremes avatar Feb 17 '23 13:02 chrysremes

Upvote!

jodb avatar Feb 17 '23 18:02 jodb

I would second that but not only for .ipynb but also for .py files. You could then execute jupyter.execSelectionInteractive command to send the code, selected by the cursor, to the interactive window that would have Databricks kernel running

jslomkowski avatar Mar 01 '23 11:03 jslomkowski

Upvote!

anandtrivedi avatar Mar 10 '23 13:03 anandtrivedi

Upvote!

anthonynassar avatar Mar 13 '23 09:03 anthonynassar

Upvote!

MingL0L avatar Mar 13 '23 09:03 MingL0L

@fjakobs will this future enhancement allow us to debug .py files line by line as well? Or shall I raise another thread for this option?

Having the option to debug files using the integrated debugger from VSCode would be awesome!

AndreiCalin24 avatar Mar 21 '23 10:03 AndreiCalin24

@AndreiCalin24 I've created on so you can upvote and track progress https://github.com/databricks/databricks-vscode/issues/589

fjakobs avatar Mar 21 '23 11:03 fjakobs

We have this as an experimental feature. Please refer to https://docs.databricks.com/en/dev-tools/vscode-ext-ref.html#additional-notebook-features-with-databricks-connect for guidelines on enabling this.

kartikgupta-db avatar Aug 16 '23 12:08 kartikgupta-db

We have cell-by-cell execution with db-connect now, but we still don't support cell-by-cell execution if you want all the code to be executed on the remote cluster. I've renamed this issues to reflect that, still keeping it open

ilia-db avatar Mar 04 '25 09:03 ilia-db