tensor_parallel icon indicating copy to clipboard operation
tensor_parallel copied to clipboard

Add mixtral support

Open ReinForce-II opened this issue 2 years ago • 0 comments

It is roughly a duplicate of llama config, adds support for mixtral models.

ReinForce-II avatar Jan 02 '24 10:01 ReinForce-II