Jason Clarence

FIX fast stable diffusion pod template TMALLOC ( memory problem fix )

4

like on https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/6722#discussioncomment-5609254. This is a fix for memory problem when user switched or loaded models/lora multiple time, then the SD will crash after. pls do tests on this fix,...

2024-05-23T09:58:01.432712734Z CUDA Version 12.1.0 2024-05-23T09:58:01.433425080Z 2024-05-23T09:58:01.433427258Z Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. 2024-05-23T09:58:01.434084437Z 2024-05-23T09:58:01.434087212Z This container image and its contents are governed by the...

Issue: Update VLLM to Version .5.0++, and a few suggestions

13

### Description 1. 🌟 **Upgrade VLLM**: We need to rocket [VLLM to version 0.5.0++](https://github.com/vllm-project/vllm/releases/tag/v0.5.0.post1) or beyond! 🚀 2. 🤖 **Tensorize Awesomeness**: The `tensorize` feature is like giving VLLM a turbo...