Amrit Ghimire

We had an repository using GITCRYPT for the config file. As a result, during the parsing of repo in Studio, we had the error as below: ```python UnicodeDecodeError: 'utf-8' codec...

Add a way to persist dataset even if exception is thrown

2

Refactoring upon the changes at #494 from the comments, this introduces the way to allow a way to persist dataset even if exception is thrown. With this change, the cleanup...

Research on using Iceberg instead of ClickHouse/SQLite

5

Current Implementation ------------ ## SQLite (Local/CLI Usage) The project uses SQLite for local operations through two main classes: 1. `SQLiteDatabaseEngine` https://github.com/iterative/datachain/blob/ed973c82f4ab4674a5a24816eaf689498117aef6/src/datachain/data_storage/sqlite.py#L98 2. `SQLiteWarehouse` https://github.com/iterative/datachain/blob/ed973c82f4ab4674a5a24816eaf689498117aef6/src/datachain/data_storage/sqlite.py#L406C7-L406C22 ## Clickhouse implementation Currently used in...

Review help/usage for cli commands

2

let's also make a ticket to review help / usage for all these commands. we have a lot of inconsistencies and bugs here: - E.g. `Commands for managing datasers` (let's...

We need to figure out docs for this as well. _Originally posted by @shcheklein in https://github.com/iterative/datachain/issues/572#issuecomment-2463030371_

Add cli support to move, remove and copy file to storage using Studio

14

This adds the support for following command ## cp ### Local to local ```bash datachain cp /tmp/test-2.py /tmp/test_folder/test-1.py datachain cp -r /tmp/test_folder /tmp/testing_folder ``` ### local to remote ```bash datachain...