sir3mat

I have a microservice that exposes some endpoints to interact with the model (like vllm or similar). How can I use my external model with Byaldi?

[Feat] Create helm chart for k8s

3

Having an helm chart could be a good improvement for on-premise installation on k8s

Inlet and outlet not called using a pipeline as a base_model to create custom model

8

Hello! When I create a model by going to Workspaces -> Model -> Create a Model and selecting the model ID of a custom pipeline as the base model, the...

Issue: docling-serve GPU Memory Leak

5

### Question: docling-serve GPU Memory Leak Description: docling-serve exhibits steadily increasing GPU memory usage over time when processing a consistent stream of documents, suggesting a memory leak. This leads to...