egress icon indicating copy to clipboard operation
egress copied to clipboard

Consider use Argo Workflow Engine to spawn pod

Open khmak3 opened this issue 3 years ago • 0 comments

By using Argo Workflow Engine, we can https://argoproj.github.io/workflows/

  1. Easy to scale up for transcode by spawn pod dynamically
  2. Allocate and limited CPU to ensure each pod will not affect the other also spot instance for cost saving https://argoproj.github.io/argo-workflows/cost-optimisation/
  3. Factorize existing workflow into multiple step to introduce re-try (Such as if push egress file to public cloud fail, the file will be lost forever with current implementation https://argoproj.github.io/argo-workflows/retries/

khmak3 avatar Sep 12 '22 22:09 khmak3