C.X.Yang comments

Repositories
Issues
Comments

Results 2 comments of


                                            C.X.Yang

[feat]: Support weight only gemm with 2bit

Fantasy, I'll try it later

Not able to add bge-m3 as the embedding model.

2025-06-13 16:20:08,437 INFO 20 172.20.0.6 - - [13/Jun/2025 16:20:08] "GET /v1/llm/factories HTTP/1.1" 200 - 2025-06-13 16:20:12,363 INFO 20 172.20.0.6 - - [13/Jun/2025 16:20:12] "GET /v1/user/tenant_info HTTP/1.1" 200 - 2025-06-13 16:20:12,419...