Javier Kohen

Flaky test: TestTailFuzz

2

This test failed during presubmit, and it's unrelated to my PR (which was documentation only): https://travis-ci.com/Stackdriver/stackdriver-prometheus-sidecar/builds/94064905 @fabxc how can we investigate this?

Use LogitsProcessor instead of LogitsWarper

1

LogitsWarper was removed from HuggingFace. LogitsProcessor is a drop-in replacement. See https://github.com/huggingface/transformers/pull/32626

### Cortex version v1.0.12 ### Describe the issue and expected behaviour The following code works as expected: ```python output = client.chat.completions.create( model=session.model_id, messages=messages, stream=True, ) print(f'Output: {list(output)}') ``` However, when...