Concurrency Limits

[jsun-m]

type ConcurrencyLimit struct {
	Id         uint      `db:"id" json:"-" redis:"-"`
	ExternalId string    `db:"external_id" json:"external_id,omitempty" redis:"external_id"`
	GPULimit   uint32    `db:"gpu_limit" json:"gpu_limit" redis:"gpu_limit"`
	CPULimit   uint32    `db:"cpu_limit" json:"cpu_limit" redis:"cpu_limit"`
	CreatedAt  time.Time `db:"created_at" json:"created_at,omitempty" redis:"-"`
	UpdatedAt  time.Time `db:"updated_at" json:"updated_at,omitempty" redis:"-"`
}

Currently only limited by gpu (count) and cpu millicores. Can add additional feature to limit by memory as well. @luke-lombardi We talked about limiting just by # of containers up but I'm not completely sure if that is a strong enough restriction. Say if we limit it at 10 containers, users can spin up 10 containers with max memory and max cpu which circumvents this feature.