Keith Brisson

The documentation of BaseSet's says that `inputs` can be a table of Views, but that triggers the assertion here: https://github.com/nicholas-leonard/dp/blob/616aec279b2e8fbdb8fd9f12825501545ccc3b17/data/baseset.lua#L49 It seems as though we need to manually create the...

Question: best way to cancel an ongoing generation?

3

I'm looking into how feasible it would be to interrupt an in-progress LLM or VLM generation. It seems that it's reasonably straightforward to cancel once the output tokens are being...