Extremys

OpenAI style API : Object of type SeparatorStyle is not JSON serializable

1

Hello, I've deployed the OpenAI style API in a container when trying to use through OpenAI package I get this kind of error, any idea? The command line: `python -m...

Enhancement: Add Mistral AI service provider + model selection

2

### What features would you like to see added? Hello! Recently Mistral AI, released its own OpenAI compatible API (so it should be easy to integrate). I think it would...

Support for HyperGAI/HPT1_5-Air-Llama-3-8B-Instruct-multimodal

1

Hello team, It would be so great so have this new multimodal based llama3 model supported with ollama! thanks! https://huggingface.co/HyperGAI/HPT1_5-Air-Llama-3-8B-Instruct-multimodal https://github.com/HyperGAI/HPT?tab=readme-ov-file#installation

Request for Comment: RayLLM <-> FastChat Integration

2

Hello team, I would like to suggest the idea of the integration with the [FastChat](https://github.com/lm-sys/FastChat) project (29k stars). The idea would be to being able to instantiate FastChat compatible workers...

Hello great tool, It would be great to OpenID implemented for authentication, what do you think? An other feedback around the cloning action do you think that it would make...

[Feature Request] Add support for OpenAI compatible API server

1

Hello @Blaizzy, it would be so great to have a similar OpenAI Compatible server like in https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/SERVER.md but supporting also image modality, what do you think?