Joel

Results 372 comments of Joel

So I'm just seeing this for the fist time. Thank you for the push @yury-fedotov. I feel quite strongly that we're overcomplicating things: Problem: - Business logic grows in complexity...

So we use the [Deltalake](https://delta-io.github.io/delta-rs/python/api_reference.html#deltalake.table.DeltaTable.to_pandas) Python library which doesn't seem to have an explicitly retaining this. We typically don't like to modify the underlying API and retain 1:1 relationship with...

The fundamental point is that Indices are a Pandas concept, Spark and more recently Polars decided not to mirror this concept. There is an argument that the current behaviour is...

I do keep wondering if we could have a Low-code dataset contribution workflow on the website that allowed us to accept contributions and manage the test suite for users.

@DavidRetana-TomTom this is a great push - this dataset is quite old so this may be newer functionality. I think it's a good idea to add this to our implementation....

@DavidRetana-TomTom you can open one via the Forking workflow! We'd really appreciate it if you have a chance

Hi @TristanFauvel Kedro already supports `sftp` via all the datasets implemented with [fsspec](https://filesystem-spec.readthedocs.io/en/latest/_modules/fsspec/implementations/sftp.html) (and [paramiko](https://docs.paramiko.org/en/2.4/api/client.html#paramiko.client.SSHClient.connect) underneath), see an example here: https://docs.kedro.org/en/stable/data/data_catalog_yaml_examples.html#load-a-csv-file-stored-in-a-remote-location-through-ssh

So I'm going to add my wider thinking regarding Kedro's relationship with the principles of [CRUD](https://en.wikipedia.org/wiki/Create,_read,_update_and_delete). Conceptually Kedro fits neatest into a box when you do the following operations: `READ`,`CREATE`,...

> Where are Kedro's assumptions or opinions on reproducibility stated? - So it's in the [tagline since launch](https://github.com/kedro-org/kedro/blob/1eacfab2dc61d3bb9bd59a60f0025e082ff83d07/docs/source/introduction/index.md?plain=1#L8), but that covers the concept not the implementation - Then onto @idanov...

Hi @tomaz-suller @Eric-OG thanks for the issue - this is an interesting one! Very exciting Kedro can be bestowed the honour of being your first open source contribution! We have...