dask-cloudprovider icon indicating copy to clipboard operation
dask-cloudprovider copied to clipboard

Parameterize task name definitions

Open jkanche opened this issue 3 years ago • 2 comments

on https://github.com/dask/dask-cloudprovider/blob/main/dask_cloudprovider/aws/ecs.py#L1264 the name of the worker task definition is hardcoded to dask-worker. This creates conflicts when I want to run multiple Fargate clusters, each with their own images and dependencies.

jkanche avatar Jul 12 '22 19:07 jkanche

Thanks for raising this. Perhaps we should do two things here:

  • Make the task definition name configurable
  • Make the default task definition name a random UUID

Do you have any interest in contributing a fix for this?

jacobtomlinson avatar Jul 13 '22 21:07 jacobtomlinson

@jacobtomlinson happy to help; working on this PR: https://github.com/dask/dask-cloudprovider/pull/364

jkanche avatar Jul 14 '22 21:07 jkanche