broadway
broadway copied to clipboard
dashbitco
Concurrent and multi-stage data ingestion and data processing with Elixir
This feature will allow developers to invoke a Broadway pipeline from ad-hoc processes. For example, if you have a Cowboy handler, you may want to use Broadway features from each...
As advice in [issue 25](https://github.com/dashbitco/broadway/issues/255), add support of function type `:batch_size`. There are two difference with original suggestion though: 1. The initial counter is detected in function when the second...
Hi! I am looking to use Broadway for a use case where each message has varying byte size and i would like to limit each batch to a certain byte...
Issue opened to collect feedback from the community.
Can we extend broadway to use it for stream processing? I have something like the Kafka Streams DSL in mind. Let's take `join` as an example. Like in `flow` we...
Discussing on broadway_rabbitmq @josevalim [commented](https://github.com/dashbitco/broadway_rabbitmq/issues/60#issuecomment-811452706) about this possibility. I was thinking that restarting everything could be avoided by changing `BatchProcessorSupervisor` and `ProcessorSupervisor` to a `:simple_one_for_one` supervisor(or a DynamicSupervisor), but I...
This issue is open to collect feedback and use cases.
I have been on a team using Broadway this year to build an ETL application for migrating data from MSSQL tables into Postgres tables. With a custom Tds producer, this...
Removing filler words and passive voice from docs #354
I am strongly in favor of removing filler words and passive voice. I would be ok with removing vague and ambiguous ones too, if they are being harmful, but I...