chattr icon indicating copy to clipboard operation
chattr copied to clipboard

Updating Databricks Available Models

Open zacdav-db opened this issue 1 year ago • 0 comments

Databricks changes the available models over time as new models become available (or older models are removed).

https://docs.databricks.com/en/machine-learning/foundation-models/index.html#pay-per-token-foundation-model-apis

Important

Starting December 11, 2024, Meta-Llama-3.3-70B-Instruct replaces support for Meta-Llama-3.1-70B-Instruct in Foundation Model APIs pay-per-token endpoints.

The following models are now retired. See Retired models for recommended replacement models.

Llama 2 70B Chat

MPT 7B Instruct

MPT 30B Instruct

Given this, I've changed the docs, vignette, and configs. I've also removed mixtral/dbrx as default options due to their age, these can always be used by specifying model names directly.

zacdav-db avatar Dec 24 '24 04:12 zacdav-db