Amano

Results 4 comments of Amano

```python from transformers.generation.streamers import BaseStreamer class ChatStreamer(BaseStreamer): def __init__(self, tokenizer) -> None: super().__init__() self.tokenizer = tokenizer self.text_queue = Queue() self.stop_signal = None def put(self, value): if len(value.shape) > 1 and...

locust\contrib\fasthttp.py", line 319, in iter_lines for chunk in response.iter_content(chunk_size=1024, decode_content=True): ^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'ResponseContextManager' object has no attribute 'iter_content' ```python for line in client.iter_lines( "/llm/v1/chat/completions", method="POST", json=payload, headers=headers, name=endpoint_name ): chunk_data...

It does work on 404 page