chattr
chattr copied to clipboard
Updating Databricks Available Models
Databricks changes the available models over time as new models become available (or older models are removed).
https://docs.databricks.com/en/machine-learning/foundation-models/index.html#pay-per-token-foundation-model-apis
Important
Starting December 11, 2024, Meta-Llama-3.3-70B-Instruct replaces support for Meta-Llama-3.1-70B-Instruct in Foundation Model APIs pay-per-token endpoints.
The following models are now retired. See Retired models for recommended replacement models.
Llama 2 70B Chat
MPT 7B Instruct
MPT 30B Instruct
Given this, I've changed the docs, vignette, and configs. I've also removed mixtral/dbrx as default options due to their age, these can always be used by specifying model names directly.