Dalton Flanagan

Improve state passing

3

Form options (CSV/JSON) are currently passed through the OAuth `state` string parameter. This complicates passing state and is nonstandard. Instead, we should be storing this state locally with the `state`...

Conditionally loaded modules

2

Having access to all of the best APIs in one CLI is awesome! 🚀 I've been thinking of how we could overcome the downsides: * 2 seconds from run to...

ollama inference should verify models are downloaded before serving

1

Right now, if you start a distribution using `remote::ollama` without the models downloaded, ollama will attempt to download it upon the first inference request: ``` INFO: Uvicorn running on http://[::]:5001...

The Llama CLI streamlines downloading a Llama model: ``` llama download --model-id Llama3.1-70B-Instruct ``` A nice improvement would be enabling `--model-ids MODEL_A,MODEL_B` to download multiple models in one go!