guunergooner

When the server restarts, container had no permission to access nvidia-uvm/nvidia-uvm-tools/nvidia-modeset device

6

/kind bug /kind cgroup ### 1. Issue or feature description When the server restarts, nvidia-device-plugin-daemonset cannot load the nvidia-uvm/nvidia-modeset device correctly ### 2. Steps to reproduce the issue * Config...

* log_format_text: 日志的输出格式，json或者plaintext，true会输出成json格式，false会输出成非json格式 * code review ``` var logInfo string for _, sink := range l.sinks { if l.logFormatText { levelstr := FormatLogLevel(log.LogLevel) extraData, ok := log.Data["error"].(string) if ok &&...

**What happened**: * Create a sharegpu instance of a large image concurrently, and delete some sharegpu instances when the image is pulled, which will cause the sharegpu instance creation to...

ImportError: cannot import name 'ComputerCallOutput' from 'openai.types.responses'

1

### Confirm this is an issue with the Python library and not an underlying OpenAI API - [x] This is an issue with the Python library ### Describe the bug...

[Feature]: Support openai responses API interface

7

### 🚀 The feature, motivation and pitch OpenAI has released a new Responses API, but vLLM does not currently support it. We request that vLLM adds compatibility with this API...