Dilyan Marinov
Dilyan Marinov
## Why? VDK doesn't provide a way to set sensitive configuration like passwords, such as trino_password. The only way to currently do this is by adding config keys and fetching...
Follow-up from https://github.com/vmware/versatile-data-kit/issues/1722 ## Overview We should remove https://github.com/vmware/versatile-data-kit/blob/main/projects/vdk-plugins/vdk-oracle/src/vdk/plugin/oracle/oracle_plugin.py#L39 because it will be pulled from secrets anyway after #1722 is implemented. ## Acceptance criteria 1. Remove the secrets override in...
## Overview `ingest_payload` does a commit here https://github.com/vmware/versatile-data-kit/blob/main/projects/vdk-plugins/vdk-oracle/src/vdk/plugin/oracle/ingest_to_oracle.py#L235 But we already call commit after every query https://github.com/vmware/versatile-data-kit/blob/main/projects/vdk-plugins/vdk-oracle/src/vdk/plugin/oracle/oracle_connection.py#L94 We should test if we need the commit in `ingest_payload`. Removing it and...
## Overview ### Prerequisites https://github.com/vmware/versatile-data-kit/issues/2933 [Benchmark values](https://github.com/vmware/versatile-data-kit/issues/2907#issuecomment-1823484629) ### Use case of payload objects with different key sets. https://github.com/vmware/versatile-data-kit/blob/main/projects/vdk-plugins/vdk-oracle/tests/jobs/oracle-ingest-job-different-payloads-no-table/10_ingest.py#L6 We still want to be able to batch queries using `cursor.executemany()`. This...
## Overview Passing `math.nAn` as part of an ingestion payload currently leads to ingestion errors. Passing `None` has not been tested. We should support passing both without any ingestion errors....
## Overview VDK should be able to ingest data into multiple database of the same type. For example, users should be able to pull data from an api, process it...
## Overview We should be able to support the following scenario, because the default db type and ingestion method are configured separately. However, this needs to be verified and functional...
## Overview When two or more database plugins are installed, the `db_connection_decorate_operation` and `db_connection_recover operation` hooks for all of them are run inside managed_cursor.py. This happens regardless of the `db_default_type`...
## Overview The primary objective is to ensure that permissions and restrictions set on Confluence pages are accurately reflected within an associated vector database. This aims to maintain consistent access...