sagemaker-distribution icon indicating copy to clipboard operation
sagemaker-distribution copied to clipboard

Set the inference server port based on SAGEMAKER_BIND_TO_PORT environment variable

Open giuseppeporcelli opened this issue 11 months ago • 0 comments

🚀 The feature, motivation and pitch

Set the inference server port based on SAGEMAKER_BIND_TO_PORT environment variable, to support multi-container endpoints and inference pipelines.

If the container needs to listen on a second port, choose a port in the range specified by the SAGEMAKER_SAFE_PORT_RANGE environment variable.

Reference: https://docs.aws.amazon.com/sagemaker/latest/dg/multi-container-troubleshooting.html#multi-container-missing-accept

Use case description

No response

Alternatives

No response

Additional context

No response

giuseppeporcelli avatar May 18 '25 18:05 giuseppeporcelli