vocode-python icon indicating copy to clipboard operation
vocode-python copied to clipboard

[Feature]: Add support for Groq (LLM)

Open spikecodes opened this issue 1 year ago • 4 comments

Brief Description

Add support for using Groq as an LLM

Rationale

Groq has an OpenAI-compatible API that allows you to call Mixtral LLM generation on their specialized hardware known as LPUs (Language Processing Units) to get high quality output at 4x the speed of GPT 3.5.

Suggested Implementation

Create a new LLM

spikecodes avatar Mar 06 '24 18:03 spikecodes

This would be epic!

XIII-IIIX avatar Mar 11 '24 09:03 XIII-IIIX

+1

djjrock avatar Mar 12 '24 15:03 djjrock

i have added support for groq #526

Arunprakaash avatar Mar 25 '24 14:03 Arunprakaash