kamu-cli
kamu-cli copied to clipboard
kamu-data
New generation decentralized data lake and a streaming data pipeline
Yaml serialized no longer includes `---\n` prefix which I was foolishly stripping without asserting on line content.
I am facting the issue with EventTime column, even though I have followed the date format as mentioned in the yaml file. please help **yaml file start** kind: DatasetSnapshot version:...
User reported that `kamu` fails to pull a root dataset when installed on fresh Fedora host: ``` [4/7] Failed to update root dataset (ca.bankofcanada.exchange-rates.daily) Summary of errors: ca.bankofcanada.exchange-rates.daily: Ingest error:...
`sparkmagic` currently transforms SQL queries into spark code with resulting dataframe transferred in stringified form. Since type information is lost `pandas` tries to guess the datatypes and often does it...
Are there some examples around the CKAN.API For example I like to use this opendata set: https://ckan.dataplatform.nl/dataset/speeltoestellen/resource/a8e4bb02-f072-424a-8663-5a5f0fe7c7c0 API call: https://ckan.dataplatform.nl/api/3/action/datastore_search?resource_id=a8e4bb02-f072-424a-8663-5a5f0fe7c7c0&limit=5 on this platform we have 1900 opendata sources, will be...
When reading CSV and coercing a column into `DATE` type the reader fails to parse value in `day/month/year` and silently outputs ALL rows as `null`. Expectation: a readable error is...
`Kryo serialization failed: Buffer overflow` when manipulating large GIS data
## Description Closes: https://github.com/kamu-data/kamu-cli/issues/306 Done: 1. Updated QueryService::get_schema() to return Arrow schema sourced from SetDataSchema event. 2. Existing logic that returns schema of the last Parquet file in the dataset...
## Problem Serializing a dataset that contains columns with `DECIMAL(s,p)` logical type currently results in a crash. ## Steps to reproduce 1. Go to `examples/currency_conversion` 2. Change data type of...
## Description Closes: ## Checklist before requesting a review - [ ] [CHANGELOG.md](./CHANGELOG.md) updated - [ ] API changes are backwards-compatible - [ ] Workspace layout changes include a migration...
