Panos

icon indicating a website link https://optas.github.io/

icon location Bay Area icon location Building something new! Previously: Head-Applied-Research@SteelPerlot RS@SNAP DPhil@Stanford RS@FAIR, ML@Autodesk, RS@Max Planck Cybernetics

Results 1 issues of Panos

[Feature] Qwen VL 2.5 Evaluation via LM-Harness

### Feature request Incorporate the evaluation of the Qwen 2.5 Vision-Language model in Oumi via LM-Harness. E.g., so to report [MMMU](https://mmmu-benchmark.github.io/) scores on all subsets. ### Motivation / references -...

enhancement
Multimodal
Feature