multi_token icon indicating copy to clipboard operation
multi_token copied to clipboard
verified publisher icon sshh12

OpenAI Client for Serving

Open SulRash opened this issue 1 year ago • 1 comments

I'd love to update and merge an OpenAI compatible serving script for these models if possible

SulRash avatar Jul 29 '24 12:07 SulRash

Hey! Happy to accept a PR. Not sure how OpenAI spec handles multimodal inputs but I'm open to it.

sshh12 avatar Jul 31 '24 01:07 sshh12