vscode-ai-toolkit icon indicating copy to clipboard operation
vscode-ai-toolkit copied to clipboard

Hope add qwen2.5-coder npu optimized

Open xgdgsc opened this issue 10 months ago β€’ 3 comments

Thansk for the deepseek 7b and 14b npu optimized models on x elite. I hope theres' qwen2.5-coder npu optimized version which work better In my use case .

xgdgsc avatar Mar 05 '25 02:03 xgdgsc

Thank you for your feedback. We are currently working on this model, and there will be an update later.

luhan2017 avatar Mar 25 '25 03:03 luhan2017

@luhan2017 @vriveras @timenick @hibrenda Thanks for your work on this! Could you please ensure that tool/function calling support is included for agents across these model sizes β€” 7B, 14B, and 32B (Instruct instead of the base model) β€” prioritizing the larger sizes first (starting with 32B)? Also, please document the quantization used in the model card. @xgdgsc If possible, could you update your original post to reflect this request as well?

Really excited to see this come together β€” thanks again! πŸ™Œ

zytoh0 avatar Apr 04 '25 06:04 zytoh0

Thank you for your feedback. We've added this to our backlog for future consideration. While we can’t commit to a timeline right now, your input helps us prioritize improvements.

hi-brenda avatar May 28 '25 08:05 hi-brenda