Clément Dumas

Results 87 comments of Clément Dumas

Same for `behaviors.json` and `prompts.json` unsure if we want to package it or let the user redefine it in their local project. I feel like for this one it makes...

I've started a draft PR here: #18

An example would be I have a codebase with some ways to train different model organisms and want to use bloom as part of my evaluation pipeline. I'd pip install...

We already have uv support on Isha's branch no?

@xuhaolei this is pretty cool but looks like you'll have to maintain your fork of vLLM yourself for this to work right?

Feels like if you have a very good test harnesses this might be automatable with Claude opus

Also maybe you should benchmark against nnsight's vllm integration to check if you're faster