datagen

datagen copied to clipboard

Enhance Datagen with Protobuf Support and Nested Key References

3

## What type of PR is this? - [ ] ♻️ Refactor - [X] ✨ Feature - [ ] 🐛 Bug Fix - [ ] 👷 Optimization - [X] 📝...

recursethis

It would be great if a field could reuse the generated value from another field. This currently works with `parent_field` and `child_field` to specify a foreign key relationship in `_meta.relationships`,...

chuck-alt-delete

### Is your feature request related to a problem? Please describe. At the moment we only test the datagen ability to produce data to Kafka. We should also add some...

bobbyiliev

### Describe the bug error when input sql uses multiple columns as primary key ### To Reproduce ``` datagen -s tests/schema2.sql ```

chuck-alt-delete

### Describe the bug When producing tests/products.sql with avro output format, there is an error in the avro schema because of a period in the name. If the avro record...

chuck-alt-delete

Right now we have `--record-size` and `--wait`, but perhaps we could customize them so that the workload feels bursty -- a lot for 10 minutes, then very slow, then a...

chuck-alt-delete

Right now, we can set `records_per` equal to, say, `5`, which means there are 5 child records for every parent record. But what if we want another, non-uniform distribution? Like,...

chuck-alt-delete

Feature: support envelope debezium

1

### Is your feature request related to a problem? Please describe. It could be powerful to support outputting data in a debezium format. While semantically, it is not any different,...

sjwiesman

It would be great if you could also use the faker.js collections for avro defined schemas.

bobbyiliev

We need to add the `_meta.relationships` list to .sql schemas to support foreign key relationships

chuck-alt-delete