dungbeetle
dungbeetle copied to clipboard
zerodha
A highly opinionated, distributed job-queue built specifically for queuing and executing heavy SQL read jobs asynchronously. Supports MySQL, Postgres, ClickHouse.
- Rebrand `sql-jobber` to the new name `DungBeetle`. - Significant rewrite and cleanup of the old system. - Breaking changes in config variables. Functionality remains the same.
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.7.0 to 0.17.0. Commits b225e7c http2: limit maximum handler goroutines to MaxConcurrentStreams 88194ad go.mod: update golang.org/x dependencies 2b60a61 quic: fix several bugs in flow control accounting 73d82ef...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
The code inside cmd/jobber.go func writeResults(jobID string, task *Task, ttl time.Duration, rows *sql.Rows, jobber *Jobber) (int64, error) { ``` for rows.Next() { if err := rows.Scan(resPointers...); err != nil {...
Hi, i'm playing with sql-jobber ... and asking if could be interesting adding new drivers https://github.com/sijms/go-ora _ "github.com/sijms/go-ora/v2" // sql.Open("oracle", "oracle://OT:yourpassword@localhost/XE") https://github.com/mithrandie/csvq-driver _ "github.com/mithrandie/csvq-driver" // sql.Open("csvq", "/path/to/data/directory") And even.. https://pkg.go.dev/cloud.google.com/go/bigquery...
I think could be interesting use something like [fsnotify](https://github.com/fsnotify/fsnotify) to watch changes in sql file (when debugging or running outside the build... i need to try all the options) but...
As comented in [this issue](https://github.com/knadh/sql-jobber/issues/18) here we can discuss options to implements new drivers (or plugins) in a fancy way that could select and reduce (in the build) dependencies, mantaining...
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.10.0 to 0.23.0. Commits c48da13 http2: fix TestServerContinuationFlood flakes 762b58d http2: fix tipos in comment ba87210 http2: close connections when receiving too many headers ebc8168 all: fix...
dungbeetle currenly has client api and HTTP endpoints for doing things like - Posting task - Scheduling job - Getting task status ### Use Case: Lets consider case when one...
