Isaac Chung

[WIP] Support open-clip onnx export

24

# What does this PR do? Fixes # (issue) https://github.com/huggingface/optimum/issues/1450 ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other...

predict_insample step_size fix

23

Fixes https://github.com/Nixtla/neuralforecast/issues/866 **Solution** - predict_insample always sets step_size=1 at the beginning of the function but stores the value set by the user. - the troubling condition will always be satisfied...

Create extra samples with surplus images

11

Addresses issue https://github.com/mlfoundations/open_flamingo/issues/231 - chunk and yield a sample every `max_num_images` valid images - refactor `preprocess_gpt_interleaved` and `preprocess_interleaved`

## Checklist for adding MMTEB dataset Reason for dataset addition: - [x] I have tested that the dataset runs with the `mteb` package. - [x] I have run the following...

fix: Convert Reddit cluster s2s and p2p to fast

8

## Checklist for adding MMTEB dataset Resolve https://github.com/embeddings-benchmark/mteb/issues/728 - [x] I have tested that the dataset runs with the `mteb` package. - [x] I have run the following models on...

Part of #660

Part of https://github.com/embeddings-benchmark/mteb/issues/660 - s2s - p2p

## Checklist - [x] Run tests locally to make sure nothing is broken using `make test`. - [x] Run the formatter to format the code using `make lint`.

Option to remove cached dataset files on large runs

2

When running all retrieval tasks, a machine can easily run out of disk space, as loading a dataset stores the dataset files in a cache directory (usually `~/.cache/huggingface/datasets`). e.g. ```python...

Sort benchmarks by name

2

When listing all available benchmarks, we wish to - list the MTEB ones first, sort those by name - then sort the rest by name From https://github.com/embeddings-benchmark/mteb/pull/1256#pullrequestreview-2335849861