llm-colosseum icon indicating copy to clipboard operation
llm-colosseum copied to clipboard

ELO ranking score?

Open Tokkiu opened this issue 1 year ago • 3 comments

截屏2024-04-10 11 34 05

How to generate this ranking? If I added new model, how to reproduce this benchmark?

Tokkiu avatar Apr 10 '24 03:04 Tokkiu

My new model is implemented in this pr. https://github.com/OpenGenerativeAI/llm-colosseum/pull/45/files You can watch the video of my model vs mistral at here. https://github.com/Tokkiu/llm-colosseum?tab=readme-ov-file#1-vs-1-mistral-vs-solar

Tokkiu avatar Apr 10 '24 03:04 Tokkiu

我的新模型已经在这个 PR 中实现。https://github.com/OpenGenerativeAI/llm-colosseum/pull/45/files您可以在这里观看我的模型与 Mistral 的视频。 https://github.com/Tokkiu/llm-colosseum?tab=readme-ov-file#1-vs-1-mistral-vs-solar

你好璟琦,我对这个项目也非常感兴趣,可以交流吗?

shawokou123 avatar Apr 10 '24 05:04 shawokou123

I just launch 50 rounds for two models. the result shows who is a better models. at the moment, Gemma 7B is the best. v1.1 is worse.

taozhiyuai avatar Apr 12 '24 12:04 taozhiyuai