ali asaria
ali asaria
``` INFO: 127.0.0.1:59469 - "GET /server/worker_start?model_name=TransformerLab-mlx/MLX-Mistral-7B-Instruct-v0.2-1709360046_rivet&model_filename=/Users/timk/.transformerlab/workspace/models/MLX-Mistral-7B-Instruct-v0.2-1709360046_rivet&adaptor=&engine=mlx_server&experiment_id=1¶meters={%22inferenceEngine%22:%22mlx_server%22} HTTP/1.1" 200 OK INFO: 127.0.0.1:59401 - "GET /server/worker_healthz HTTP/1.1" 200 OK INFO: 127.0.0.1:59401 - "GET /server/worker_healthz HTTP/1.1" 200 OK INFO: 127.0.0.1:59401 - "GET /server/info...
Closing as stale
Closing as this is old.
You're right we should allow changing this or make it automatically pick an available port if 8000 is not available. If you'd like to work on it, there is some...
Sorry I misunderstood. I thought you were asking if it is possible to change this in the code if you are a developer. Yes you are right it is not...
Changing the port dynamically is a bit complicated because we call uvicorn directly from a shell script in run.sh. For now I have changed the default port to 8338 https://github.com/transformerlab/transformerlab-api/commit/b0843896afa3c09d7db70e21497a0029e2b3a7e0...
This is a windows problem only. We do check if curl is installed on the client machine (but this is not right for Windows since the CURL call originates from...
Hmm the logs might tell us what happened. Can you try running the API installer script manually: `curl https://raw.githubusercontent.com/transformerlab/transformerlab-api/main/install.sh | bash` and see what output you see?
Hmm it seems http_proxy is an environment variable that curl understands and will use. But issue seems like an edge case: Transformer Lab's installer will not work behind a proxy...
Closing this merge request and hoping we can fix in the API itself