datapackage-pipelines

datapackage-pipelines copied to clipboard

This pull request fixes # 202. Changes proposed in this pull request: - geojson as format to dump datasets containing geopoints

gperonato

Consistent with https://github.com/datahq/dataflows/issues/152

gperonato

Add DPP_CELERY_TIMEZONE conf support

1

* [ ] I've added tests to cover the proposed changes Changes proposed in this pull request: - If set, env var `DPP_CELERY_TIMEZONE` value will be passed to `CELERY_TIMEZONE` conf...

abulte

Add redis user and password support

1

* [ ] I've added tests to cover the proposed changes Changes proposed in this pull request: - add support for Redis authentification through `DPP_REDIS_USERNAME` and `DPP_REDIS_PASSWORD` env vars Replaces...

abulte

Loading file with capital letters

2

When loading a file containing capital letters, an error is raised, as there is a validation problem. I have tried to correct this with `update_package `and `update_resource`, but the same...

gperonato

Add preserve_missing_values option to set_types

1

See https://github.com/frictionlessdata/tableschema-py/pull/260

cschloer

exec step

2

Added exec step which allows to run executables or shell scripts as part of the pipeline, see updated README and tests

OriHoch

[dataflows] revisit loading multiple sheets with one load step

4

see https://github.com/datahq/dataflows/pull/110 @roll

cschloer

set_types memory usage with extremely wide data

7

Hey, I have a strange dataset here that has 2500 columns and only 60 rows. The `set_types` processor slowly gobbles up all of the memory when called with all 2500...

cschloer

Add load parameter to capture skipped rows metadata

1

Hey, I understand the point of this feature being outside of the scope of tabulator (https://github.com/frictionlessdata/tabulator-py/issues/331). I think it would be an important feature to implement in load. As proposed...

cschloer