James (@sanjams)

Results 11 comments of James (@sanjams)

Given #1096 is still open, Im assuming HTTP2 is still not supported

For users less keen on updating config files, it would also be nice if these custom config values could be passed to [`start_model_server`](https://github.com/aws/sagemaker-inference-toolkit/blob/master/src/sagemaker_inference/model_server.py#L54). If there is worry these values would...

For disabling retries, you should be able to do something like the following (please note I havent tested this code myself, it serves as a reference): ```python import boto3 from...

Throwing some thoughts down: So taking an example from a [recent run](https://github.com/commaai/openpilot/actions/runs/9363053483/job/25773007600?pr=32618), it looks like the `setup-with-rety` step takes 75 seconds. The majority of this time is spent in downloading...

@cartermckinnon any way you could give this a quick glance and see if there is anything glaring? thanks in advance!

The test errors seem unrelated to my change. I also cannot find an existing issue noting a similar symptom to these failures.

I have read the CLA Document and I hereby sign the CLA