etl
etl copied to clipboard
R package to facilitate ETL operations
It seems like this might provide significant advantages: https://arrow.apache.org/docs/r/
Need to replace with DBI.
For example, figure out `smallint(4)` for `numeric`.
@beanumber have you applied this framework to spatial data? I noticed that the macleish uses spacial data but from my understanding it doesn't load the spatial data to the SQL...
in conjunction with listing existing files. Always return `fs::path` vectors
https://case.law/
The [new dm package](https://krlmlr.github.io/dm/) offers a class that holds a number of tables and their referential relationships, among other things. Would this be a good target container for {etl}?
`find_schema` looks in `package_root/sql` to find sql source files. But when running unit tests the files are in `package_root/inst/sql`. This makes it impossible (as far as I can tell) for...
* (https://github.com/beanumber/nyc311/issues/16) * (https://github.com/beanumber/statcastr/issues/3)