Anjor Kanekar

This is probably a large workstream, and we may not want to do it in the end, but figured I would capture it. Users should be able to grant other...

Loglikelihood refactor

3

Not sure if utils.py is the best place for these functions. Open to starting a new utils file under models.

Documentation about tasks <> request types mapping

1

This table in the readme outlining which request type is supported for each API is super useful. However, as a user I usually want to run a set of benchmarks...

Fixes https://github.com/EleutherAI/lm-evaluation-harness/issues/1165 Will require someone with permissions on pypi to set up trusted publishing by following these steps: https://docs.pypi.org/trusted-publishers/adding-a-publisher/ and a similar one for testpypi

It would be helpful to have a formalised contributing guide.

Retrieval not working

4

Getting this error when I try to access a retrieval link from the deals page.

Estuary performance and deals pages don't load

3

https://estuary.tech/ecosystem#performance https://estuary.tech/ecosystem#deals

see https://filecoinproject.slack.com/archives/C016APFREQK/p1672235162775909 for context

Today the replacePin endpoint removes the old content, and adds the new content. This results in a situation where we have "gaps" in the content ids which can be a...

There's loads of duplicate code spread across shuttle and api which should be consolidated into one place.