Jing Dong issues

Repositories
Issues
Comments

Results 1 issues of


                                            Jing Dong

Bug Report: lorax-launcher failed with --source "s3" for model_id "mistralai/Mistral-7B-Instruct-v0.2"

### System Info lorax_version: "a7e8175" Python 3.10.8 Platform: ml.g5.16xlarge (AWS) When deploy the docker container with the source from "s3" and model_id "mistralai/Mistral-7B-Instruct-v0.2" (`lorax-launcher --port 8080 --source "s3"`), it failed...

bug