Qianhao Dong comments

Results 15 comments of


                                            Qianhao Dong

feature request MCP server tools, LM Studio integrations.

Thanks for feature request. Need more info to understand detailed feature scopes. E.g., what's the expected behaviors to use AI Toolkit together with MCP / LM Studio. And, are there...

gemini-2.0-flash-thinking-exp

Hi, currently custom model only supports OpenAI contract. Marked this as `feature request` and will be track in further planning.

feat: auto remove ollama local models if they are no longer there

Thanks for the suggestion. Marked this as feature `enhancement` and will be tracked in further planning.

Extension throws error and the output cites issues with the wrong model

Thanks for reporting. It's by designed that output panel shows on error. In your case it seems the original o1 request times out (or fails after a certain period), then...

Reporting Behaviour/Solution and Exploring Collaboration for KAITO x AKS Extension Scenarios

Thanks for the suggestion, we added "Preview" flag to the latest version (0.4.0) just released.

frequency_penalty at 0 causes no response content with Phi-3-mini-4k-cpu-int4-rtn-block-32-acc-level-4-onnx

@a1exwang - is this caused by invalid parameter? May consider adding value check for all input parameters.

Tag releases and publish release notes on GitHub

@sffamily - any concern or thought if adding the release notes to this doc repo?

[custom endpoint] Add support for getting auth token from command line

It's able to use environment variable when adding a model to "My Model" list. E.g., for Open AI models, - Create environment variable **OPENAI_API_KEY** on your machine - (Close and...

[custom endpoint] Add support for getting auth token from command line

Thanks all for the detailed scenarios. Added to our backlog. FYI @sffamily

sse_starlette is not installed when installing local finetuning dependencies

@XiaofuHuang , could you please help on this? Any dependency update that causes `sse_starlette` not installed on the latest project template?