UniEon

Error in lxc image copy after upgrade to 4.19

2

After the cluster upgrade to version 4.19 find an issue in lxc image copy with projects. Steps to replicate error: ``` # Create a test container $ lxc launch ubuntu:20.04...

There isn't any documentation of [Cacheflow worker ](https://github.com/lm-sys/FastChat/blob/main/fastchat/serve/cacheflow_worker.py) using ray cluster. Can you please provide the updated dependency even though under optional for using the cacheflow worker to serve the...

Update the bluepencil-XL to latest version 2.0.0 which is released on 1st December 2023. This model is the latest release from bluepen5805. Results are also good for sketch and pencil.

It will be nice to have support for concept sliders in Fooocus to provide better control over generation

1

It will be nice to incorporate these control in Fooocus, given it provides much better control over image generation. Attached the paper with this issue as well. The code repository...

Error in Gemma 2 using model_worker (probably an error in conversation.py)

3

When using model_worker with transformers to run Gemma 2 9B model does not work correctly and the conversation template applied to Gemma 2 model continue to generate response until model_worker...

Errors encountered when upgrading incus with sudo apt upgrade

6

# Required information * Distribution: Ubuntu * Distribution version: 24.04.4 * The output of "incus info" (it faled after upgrade, ork after resart): ``` driver: lxc | qemu driver_version: 6.0.1...

DSPy prgram timeout issue and streaming support

2

I have been trying to use DSPy with self hosted language model like qwen2-7B, gemma-2-9b-it and glm4-9b-chat, they are running on a home made GPU system consisting of dual GPU...

This pull request introduces support for the Llama 3.2-Vision collection of multimodal large language models (LLMs) within Xinference. These models bring the capability to process both text and image inputs,...

[Feature] Support for Llama 3.2 Multi-modal and Lightweight Models

2

### Feature request / 功能建议 This feature request proposes adding support for Meta's newly released Llama 3.2 models to lmdeploy. Llama 3.2 introduces exciting capabilities, including vision LLMs (11B &...

[Feature] Support Llama 3.2 family of models

2

### Motivation ## Motivation for Implementing Llama 3.2 lmdeploy Inference Engine Support Llama 3.2's release presents a strong case for expanding lmdeploy with dedicated support: * **Multi-modal Capabilities:** Llama 3.2...