morphic icon indicating copy to clipboard operation
morphic copied to clipboard
Published 4 months ago • verified publisher icon miurla

Support for using Groq

Open itsaark opened this issue 2 years ago • 1 comments

It would be awesome if you could add support for Groq!

itsaark avatar Apr 14 '24 12:04 itsaark

Groq's speed is attractive. Previously, I tried Groq because it has an OpenAI-compatible API, but I gave up on it due to an error occurring midway. Either Groq's compatibility needs to improve, or we need to wait for Groq's API to support streaming for tool calling.

https://console.groq.com/docs/openai

miurla avatar Apr 15 '24 14:04 miurla

Do you have a branch with your Groq experiment? Can we somehow help you? 🥇

ndimas avatar Apr 19 '24 15:04 ndimas

We cannot support parts that require tool calling and JSON output, but I 've made it possible to specify Groq for the final output.

https://github.com/miurla/morphic/pull/58

miurla avatar Apr 20 '24 17:04 miurla