llmops-handbook
llmops-handbook copied to clipboard
distantmagic
Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)
[Outline] I would like to add a section about optimizing the speed and response times from LLMs under General Concepts. I plan to include the below topics: - Quantization -...
[Outline] The handbook does not contain information on how to setup llama.cpp for a Colab or Kaggle notebook which are generally used in the experimentation phase. I propose adding a...
[Outline] I would like to add to the existing section of vector databases. The general points I would like to add are: - How vector databases are different from traditional...
[Outline] I would like to add to the existing section about function calling. I plan to add the below points/topics: - Give the reader a good idea of what exactly...
Metadata
Owner
Metadata
Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)