Kyle Mistele

Name '[argument]' is not defined

1

Downloading and importing the module works fine. When I try and run it, no matter what arguments I use (`-i`, `-o`, etc.), I get an error that says `name '[whatever...

batch_size > 1 results in NaN loss value

11

## **Describe the bug** When I set a `trainer.batch_size` of > 1 or auto, my loss value is always `NaN`, and training will fail and exit at the end of...

### Feature request It would be great if OpenLLM supported pre-Ampere architecture Cuda devices. In my case, I'm looking at the volta architecture. The [README currently indicates](https://github.com/bentoml/OpenLLM?tab=readme-ov-file#-runtime-implementations) that an Ampere-architecture...

[RFC]: Deprecate stop_reason in OpenAI Entrypoint in favor of finish_reason; fix implementation of finish_reason

2

### Motivation. This RFC is motivated by a desire to ensure full OpenAI compatibility in Completions & chat completions endpoints by deprecating `stop_reason` which is not part of the OpenAI...

Support Open Models that allow OpenAI API-style tool use & "auto" tool choice

100

## DRAFT: OpenAI Tool Use Checklist This (Draft) PR will add support for OpenAI-style tool calling in a way that is minimally opinionated about tool use formats & prompt formatting....

[New Model]: allenai/Molmo-7B-0-0924 VisionLM

16

### The model to consider. https://huggingface.co/allenai/Molmo-7B-O-0924 https://huggingface.co/collections/allenai/molmo-66f379e6fe3b8ef090a8ca19 ### The closest model vllm already supports. Existing Olmo Models by AllenAi: `OLMoForCausalLM` and `OLMoEForCausalLM` are supported. ### What's your difficulty of supporting...

[SECURITY] AWS Next.js default caching behavior creates a DoS condition

1

# TL;DR **Problem**: Several default AWS behaviors combine to create a Cache poisoning vulnerability that presents a Denial of Service issue. **Solution**: - Disable caching HTTP 5XX errors in the...

Note that the generic indicators `` are gone; it appears the app is improperly trying to render them as HTML? Probably the fix is to ensure things are properly escaped.

block /clear and /compact

1

Running `/clear` causes the session to hang or fail

Cmd+Shift+H not dismissed by `Escape` keypress

1

GIVEN that I have opened the global prompt box with a `Cmd+Shift+H` hotkey press, WHEN I press `ESC` THEN I expect the popup to be dismissed Current behavior: WHEN I...