Joel

Results 372 comments of Joel

@astrojuanlu excited to see this move ever so slightly forward. The number one feature for me is the link between our "magic string" input/output/parameter references in node definitions and their...

The tool tip is awesome here! I guess dataset factories would work the same, I still think it would be nice to have an equivalent of `dbt compile` where you...

Honestly I think VS Code is the right call for any initial MVP - you can just point to [DVC](https://dvc.org/doc/install/ide-plugins) and [Databricks](https://docs.databricks.com/en/dev-tools/vscode-ext/index.html) making the same call

Disappointing but I think it's still a great step especially if we target an enterprise user persona

Hi @lancechua thank you for raising this! We have discussed this as a team and have had a good conversation regarding ways we can proceed. You will see that this...

Channelling my inner @idanov this does harm reproducibility - personally I think it's a good thing, same for conditional nodes, another things we've held off doing for the same reason.

Completely aligned on #2 I think it's related to the wider rigidity questions we have in the framework vs lib debate. FYI - how prefect do conditionals here looks neat...

Now Python 3.7 is EOL is there any advantage to using [Protocol types](https://towardsdatascience.com/protocols-in-python-110943832d98#:~:text=Python%203.8%20introduced%20a%20neat,available%20attributes%20and%20functions%20alone.) as an alternative/addition to the abstract classes?

On that last part - we're well overdue a native PyTorch dataset

I'd also highlight this line intended detect if we're talking about a Spark dataframe or not is probably quite fragile and is possibly a relic of assumptions that made sense...