local llms without using Ollama -with vllm or huggingface

[rajeshkochi444]

Hi,

Can we use local llms through vllm or huggingface without using ollama?

Thanks Rajesh

[FBR65]

I'm also interessted in vllm connections.

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

[github-actions[bot]]

This issue was closed because it has been stale for 5 days with no activity.