Luiz Miguel

@skanga Hi Thanks for being interested in Paddler! That could be an useful feature. Do you have some idea on changing the prompt for example? We can nicely talk about...

First of all, thanks for sharing you idea about the prompt. Pingora works with a [filter on proxy-level](https://github.com/distantmagic/paddler/blob/75e31d772bec77f8933aaf63b1368085aa1ac5da/src/balancer/proxy_service.rs#L242-L256), so sure, we can insert some stuff before forwarding the request, like...

miri is annoying in unncessary situations though, its supposed to be ran with unsafe code, its likely to give several errors and warning with perfect safe code.

>Or are you trying to achieve serial execution between multiple feature files Yes. >while concurrently executing scenarios inside those features? No. i want serial execution between scnearions and files, we...

So the initial usage flow and rules might be: 1 - User will use some command to start a new Supervisor instance pointing to an existing llamacpp instance. 2 -...

## Should Supervisor be optional? If the basic Paddler ecosystem can work without supervisor, just with balancer, llamacpp and some agent instance, should the supervisor have an optional compilation?

## Supervisor aggregate address Its not clear for me its purpose. Whats the point of `supervisor-aggregate-addr` arg? would `8085` be the `loadbalancer management` port server? Why would `supervisor` report `llamacpp`...

## Paddler binaries downloading Ideas, Suggestions or any more details from the community on the: > Paddler can potentially download and manage llama.cpp version that it supports. > ```bash >...

is there some API to infra state? Same as llama.cpp with `slots` endpoint? would be useful to have that due to prod env.

Hi, @ceskyDJ!! I am happy you are using Paddler, thanks for the feedback. Yes, there is no request buffering/queue for best peer selection. We might try to implement that, if...