Support for NotebookUtils

[mzivtins]

Hi

Unfortunately notebookutils is not supported under .net spark https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/microsoft-spark-utilities?pivots=programming-language-csharp#notebook-utilities

I would like to use Notebook.Run() inside a task factory as this would allow multiple notebook contexts to run under a single spark application. https://learn.microsoft.com/en-us/dotnet/api/system.threading.tasks.taskfactory?view=netcore-3.1#definition This can be done in PySpark, but .net core 3.1 taskfactory is superior.

When can we expect this support? Is it coming with .net6/7 spark support?