serverless-examples
serverless-examples copied to clipboard
feat(containers): experimentation with hugging face models
Summary
In this example, we experiment deploying some lightweight Hugging Face models (phi, llama, and mistral) using a public HF model repository. The deployment of these models is done using Terraform. They are bench-marked using a python script.
Checklist
- [x] I have reviewed this myself.
- [x] I have attached a README to my example. You can use this template as reference.
- [x] I have updated the project README to link my example.