pg2kafka
pg2kafka copied to clipboard
blendle
Ship changes in Postgres 🐘 to Kafka 📖
[//]: # (dependabot-start) ⚠️ **Dependabot Preview has been deactivated** ⚠️ This pull request was created by Dependabot Preview, and you've upgraded to Dependabot. This means it won't respond to `dependabot`...
![dependabot-preview[bot] avatar](https://avatars.githubusercontent.com/in/2141?v=4 "dependabot-preview[bot] avatar"){kind=avatar}
[//]: # (dependabot-start) ⚠️ **Dependabot Preview has been deactivated** ⚠️ This pull request was created by Dependabot Preview, and you've upgraded to Dependabot. This means it won't respond to `dependabot`...
Right now we execute a query per row, making this very slow, we should do it in one query for the entire batch that was fetched from the DB, if...
So a processor doesn't need to keep state just to know what the previous value was.
Apparently postgres doesn't encode timestamps as RFC3339 by default. This is annoying, we should look into emitting our events with RFC3339 timestamps, they're much easier to work with.
We used to run our internal CI, but we want to set up public CI for public projects.