reader
reader copied to clipboard
Perform historical snapshots without database locks and read change data capture logs from databases. Artie Reader is compatible with Debezium and written in Go.
Artie Reader
π Perform historical snapshots and read CDC streams from databases π
Learn more Β»
Artie Reader reads from databases to perform historical snapshots and also reads change data capture (CDC) logs for continuous streaming. The generated messages are Debezium capable.
Benefits
- Historical table snapshots do not require database locks, which means Artie Reader minimizes impact to database performance and avoids situations like replication slot overflow.
- Debezium compatible. The generated messages are consistent with Debeziumβs message format.
- Portable and easy to operate. Shipped as a standalone binary with no external dependencies.
Architecture
Supports:
| Snapshot | Streaming | |
|---|---|---|
| DynamoDB | β | β |
| MongoDB | β | β |
| MySQL | β | β |
| PostgreSQL | β | β |
| SQL Server | β | β |
Running
To get started, you'll need a config.yaml file, you can see examples of this in the examples folder.
go run main.go --config config.yaml