Travis Rivera comments

Repositories
Issues
Comments

Results 12 comments of


                                            Travis Rivera

chore: :arrow_up: Update ggml-org/llama.cpp to `0c7220db56525d40177fcce3baa0d083448ec813`

Is this at all related to supporting logprobs?

LOCALAI_SINGLE_ACTIVE_BACKEND=true prevents any back-ends from running at all.

Update: Using "SINGLE_ACTIVE_BACKEND" instead of "LOCALAI_SINGLE_ACTIVE_BACKEND" appears to resolve the issue. Suggesting the documentation [here](https://localai.io/advanced/#backend-flags) is outdated or flawed.