egress
egress copied to clipboard
Consider use Argo Workflow Engine to spawn pod
By using Argo Workflow Engine, we can https://argoproj.github.io/workflows/
- Easy to scale up for transcode by spawn pod dynamically
- Allocate and limited CPU to ensure each pod will not affect the other also spot instance for cost saving https://argoproj.github.io/argo-workflows/cost-optimisation/
- Factorize existing workflow into multiple step to introduce re-try (Such as if push egress file to public cloud fail, the file will be lost forever with current implementation https://argoproj.github.io/argo-workflows/retries/