transporter
transporter copied to clipboard
compose
Sync data between persistence engines, like ETL only not stodgy
## Bug report ### Relevant pipeline.js: N.A. ### System info: - Transporter version - OS: macOS Monterey - DB version(s): postgres 11.6; mongo 4.4 ### Reproducible Steps: 1. Bring up...
## Directions I´ve created a project with docker-compose. It starts a few MongoDB servers and Elasticsearch. Then it installs transporter and verifies that the sync works. I did this back...
## Bug report ### Relevant pipeline.js: ```js var source = rethinkdb({ "uri": "rethink://localhost:28015/foundation", "timeout": "30s", "tail": true, "debug": true }) var sink = postgres({ "uri": "postgres://ilia@localhost:5432/client_app_development?sslmode=disable", "tail": true, "debug": true...
## Directions Using Elastic Search 7.1 (AWS) and DocumentDB Mongo (AWS). When using file sink it works great!. When using Elastic I'm getting an error. `error="&elastic.ErrorDetails{Type:"illegal_argument_exception", Reason:"Rejecting mapping update to...
## Directions Issues are reserved for actionable bug reports and feature requests. Before opening an issue, search for similar bug reports or feature requests. If no similar issue can be...
### Relevant pipeline.js: var source = mongodb({ "uri": "mongodb://$USERNAME:$PASSWORD@6879c794-4a5c-b6c7-0008548a3e42-0.budepemd0im5pmu4u60g.databases.appdomain.cloud:31933,6879c794-903e-4a5c-b6c7-0008548a3e42-1.budepemd0im5pmu4u60g.databases.appdomain.cloud:31933,6879c794-903e-4a5c-b6c7-0008548a3e42-2.budepemd0im5pmu4u60g.databases.appdomain.cloud:31933/*?authSource=admin&replicaSet=replset" "ssl": true, "cacerts": ["/Users/Anuradha/cacert], }) var sink = mongodb({ "uri": "mongodb://$USERNAME:$PASSWORD@1b0c75a3-cb8c--9a43-39141f01eff8-0.bngflf7f0ktkmkdl3jhg.databases.appdomain.cloud:31733,1b0c75a3-cb8c-9a43-39141f01eff8-1.bngflf7f0ktkmkdl3jhg.databases.appdomain.cloud:31733,1b0c75a3-cb8c-9a43-39141f01eff8-2.bngflf7f0ktkmkdl3jhg.databases.appdomain.cloud:31733/*?authSource=admin&replicaSet=replset" "ssl": true, "cacerts": ["/Users/Anuradha/cacert”], }) t.Source("source", source, "/.\*/").Save("sink", sink, "/.\*/")...
### Required for all PRs: - [ ] CHANGELOG.md updated (feel free to wait until changes have been reviewed by a maintainer) - [ ] README.md updated (if needed)
## Directions Error `write error, All primary keys were not accounted for` when importing into Postgres sink where the table name exists in more than one schema. ## Bug report...
### Required for all PRs: - [ ] CHANGELOG.md updated (feel free to wait until changes have been reviewed by a maintainer) - [ ] README.md updated (if needed)
## Directions mongodb -> elastic search ## Bug report ### Relevant pipeline.js: ### System info: - Transporter version 0.5.2 - OS transport in the docker-container - DB version(s) mongodb v4.0.6...
