BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

bug: SSL does not work

Open ProVega opened this issue 1 year ago • 0 comments

Describe the bug

Configure SSL per instructions here - https://docs.bentoml.com/en/latest/guides/configurations.html

ssl={ "enabled": True, "certfile": "/fullpath/file.cer", "keyfile": "/fullpath/file.key", "keyfile_password": "password"

Using the exact same config into Uvicorn directly, with same key and cert and password works just fine.

I don't see how to turn on additional logging, so I don't really know what the problem is.

All requests, get this warning. 2024-05-06T07:53:05-0600 [WARNING] [entry_service:bentovllm-llama3-8b-insruct-service:1] Invalid HTTP request received. 2024-05-06T07:53:05-0600 [WARNING] [entry_service:bentovllm-llama3-8b-insruct-service:1] Invalid HTTP request received.

Enabling DEBUG doesn't yield any additional info (yes I see [DEBUG] in the output for other stuff)

To reproduce

No response

Expected behavior

SSL should work

Environment

bentoml: 1.2.12 uvicorn: 0.9.0

ProVega avatar May 06 '24 14:05 ProVega