Meghajit Mazumdar

feat: Parquet DataSource should provide ability to read multiple GCS buckets for creating multiple streams

1

As part of this issue, want to add support for handling multiple streams for Parquet Data Source. That is, users should be able to specify multiple GCS URLs. Dagger should...

feat: Analyse different strategies and add validation for missing fields in parquet data compared to protobuf schema

1

Extra fields present in the parquet data not present in the protobuf schema will be ignored. However, it might be possible that: - there are some fields in protobuf schema...

feat: implement IndexOrderedSplitAssigner

1

As part of this issue, we want to add support for configuring a split assigner which can assign splits to source readers in an `almost-deterministic` order as decided by the...

### WHAT ? Remove dependency of [jaeger-client](https://github.com/jaegertracing/jaeger-client-node) from Firehose along with usages anywhere in the code. ### WHY ? As mentioned on their Github handle, Jaeger Clients are being deprecated...

### **WHAT ?** Deprecate config `SINK_HTTP_PARAMETER_SCHEMA_PROTO_CLASS` ### WHY ? For a Firehose with HTTP Sink configured with header or query parameter source ( that is, `SINK_HTTP_PARAMETER_SOURCE` != disabled), the proto...

This is the first step towards creating a better quickstart documentation. Contains more step by step details on how to run dagger locally. In the future, we will add more...

**Summary** As of now, there is some issues in the local setup of Dagger: 1. The `local.properties` assumes there is a `TestMessage` [proto present](https://github.com/odpf/dagger/blob/main/dagger-core/env/local.properties#L6). However, it is not the case....