pdr-backend

pdr-backend copied to clipboard

Fix Issue1076 - Scope down queries, Fix drop, Improve DRY, Stabilize e2e ETL

9

Fixes #1076 bronze_predictions and other tables are starting + ending like how we would expect it to, at the end of the first run...  I had to...: - [x]...

idiom-bytes

## Context Binance futures has the lower fees and most liquidity, making it the best choice for trading. ## DoD Note: There are no Binance Futures feeds on Predictoor at...

trizin

Fixes #1032.

KatunaNorbert

Fixes #1073 Changes proposed in this PR: - Add payout batch size configuration for predictoor_ss - Add batch processing for pending slots in find_shared_slots function - Add tests for different...

trizin

Fixes #769 Changes proposed in this PR: - [x] Renamed everything from persistent_data_store -> duckdb_data_store

idiom-bytes

[WIP][Do Not Merge] Fix #685 - DuckDB - E2E Integration

3

Fixes #685

idiom-bytes

[DuckDB][ETL] Scope down Queries/ETL + Increase base quality

1

**Describe the bug** Like I had proposed before... we're still having issues in our queries/ETL that are causing a bunch of distractions. These are queries that extend beyond our core...

idiom-bytes

### Motivation We have now verified that the basic lake functionality is working as expected. We now want to verify the data quality and completeness. This means that additional SQL...

idiom-bytes

[Lake][ETL] DuckDB E2E - Ingestion -> Dashboards

1

### Motivation We completed the techspikes around our data infrastructure. As an outcome, we're going to implement our ETL pipeline in DuckDB such that we maintain many of our constraints:...

idiom-bytes

[Lake][Incremental Pipeline] Use bronze_pdr_predictions to manage active checkpoint

7

### Background / motivation Inferring where to resume the pipeline from is having issues. It's not about "removing subscriptions" from this logic, we need to think about the system and...

idiom-bytes