WeKnora icon indicating copy to clipboard operation
WeKnora copied to clipboard
Published 3 months ago • verified publisher icon Tencent

[Bug]: 添加多模态模型测试都是测试通过

Open jlau-ice opened this issue 7 months ago • 1 comments

相关组件

后端服务及API

Bug 描述

多模态用的是qwen-vl-2.5 7B 的 vllm 部署的。 Image 前端这个测试，随便填个地址都能通过 Image

期望行为

多模态测试结果应该是 图片里面的内容，等情况

相关日志

docker logs -f WeKnora-app
......
25/09/29 09:36:27 /app/internal/application/repository/model.go:32 record not found
[0.289ms] [rows:0] SELECT * FROM "models" WHERE id = '' AND (tenant_id = 10000 or tenant_id = 0) AND "models"."deleted_at" IS NULL ORDER BY "models"."id" LIMIT 1
ERROR[2025-09-29 09:36:27.351] [request_id=Ax3TWgig56UY] model.go:117[GetModelByID] | Model not found
INFO [2025-09-29 09:36:27.351] [request_id=Ax3TWgig56UY] model.go:37[CreateModel] | Start creating model
INFO [2025-09-29 09:36:27.351] [request_id=Ax3TWgig56UY] model.go:38[CreateModel] | Creating model: qwen2.5-vl, type: VLLM, source: remote
INFO [2025-09-29 09:36:27.351] [request_id=Ax3TWgig56UY] model.go:42[CreateModel] | Remote model detected, setting status to active
INFO [2025-09-29 09:36:27.351] [request_id=Ax3TWgig56UY] model.go:45[CreateModel] | Saving remote model to repository
INFO [2025-09-29 09:36:27.352] [request_id=Ax3TWgig56UY] model.go:55[CreateModel] | Remote model created successfully: 5049e619-6b47-4f2c-be76-82f10a322289
INFO [2025-09-29 09:36:27.353] [request_id=Ax3TWgig56UY]                      | Model qwen3:32b already exists
INFO [2025-09-29 09:36:27.353] [request_id=Ax3TWgig56UY] model.go:85[func1]   | Model download completed successfully: qwen3:32b
INFO [2025-09-29 09:36:27.353] [request_id=Ax3TWgig56UY] model.go:88[func1]   | Updating model status to: active
INFO [2025-09-29 09:36:27.353] [request_id=Ax3TWgig56UY] initialization.go:416[InitializeByKB] | Knowledge base configuration updated successfullykbId610d3017-0f87-462f-a9cf-b1324c6fbbf4
INFO [2025-09-29 09:36:27.354] []                      | [Ax3TWgig56UY] 200 | 2747 |   14.184563ms | 192.168.172.226 | POST /api/v1/initialization/initialize/610d3017-0f87-462f-a9cf-b1324c6fbbf4
INFO [2025-09-29 09:36:27.355] [request_id=Ax3TWgig56UY]                      | Model bge-m3:latest already exists
INFO [2025-09-29 09:36:27.355] [request_id=Ax3TWgig56UY] model.go:85[func1]   | Model download completed successfully: bge-m3:latest
INFO [2025-09-29 09:36:27.355] [request_id=Ax3TWgig56UY] model.go:88[func1]   | Updating model status to: active

2025/09/29 09:36:27 /app/internal/application/repository/model.go:69
[2.596ms] [rows:1] UPDATE "models" SET "id"='21d5fc36-3f68-442e-ab9a-3ad29c438a1f',"name"='qwen3:32b',"type"='KnowledgeQA',"source"='local',"description"='LLM Model for Knowledge QA',"status"='active',"created_at"='2025-09-29 09:36:27.343',"updated_at"='2025-09-29 09:36:27.354' WHERE (id = '21d5fc36-3f68-442e-ab9a-3ad29c438a1f' AND tenant_id = 0) AND "models"."deleted_at" IS NULL

2025/09/29 09:36:27 /app/internal/application/repository/model.go:69
[1.513ms] [rows:1] UPDATE "models" SET "id"='d6a84cce-0f9a-4ed2-afb8-59b26b3bacff',"name"='bge-m3:latest',"type"='Embedding',"source"='local',"description"='Embedding Model',"parameters"='{"base_url":"","api_key":"","embedding_parameters":{"dimension":1024,"truncate_prompt_tokens":0}}',"status"='active',"created_at"='2025-09-29 09:36:27.346',"updated_at"='2025-09-29 09:36:27.355' WHERE (id = 'd6a84cce-0f9a-4ed2-afb8-59b26b3bacff' AND tenant_id = 0) AND "models"."deleted_at" IS NULL
INFO [2025-09-29 09:36:28.917] [request_id=Zrdh2frUYmg0] tenant.go:84[GetTenantByID] | Start retrieving tenant
INFO [2025-09-29 09:36:28.917] [request_id=Zrdh2frUYmg0] tenant.go:91[GetTenantByID] | Retrieving tenant, ID: 10000
INFO [2025-09-29 09:36:28.917] [request_id=Zrdh2frUYmg0] tenant.go:101[GetTenantByID] | Tenant retrieved successfully, ID: 10000, name: admin's Workspace
INFO [2025-09-29 09:36:28.918] [request_id=Zrdh2frUYmg0] knowledgebase.go:162[ListKnowledgeBases] | Start retrieving knowledge base list
INFO [2025-09-29 09:36:28.918] [request_id=Zrdh2frUYmg0] knowledgebase.go:172[ListKnowledgeBases] | Retrieving knowledge base list for tenant, tenant ID: 10000
INFO [2025-09-29 09:36:28.918] [request_id=Zrdh2frUYmg0] knowledgebase.go:95[ListKnowledgeBases] | Retrieving knowledge base list for tenant, tenant ID: 10000
INFO [2025-09-29 09:36:28.918] [request_id=Zrdh2frUYmg0] knowledgebase.go:105[ListKnowledgeBases] | Knowledge base list retrieved successfully, tenant ID: 10000, knowledge base count: 1
INFO [2025-09-29 09:36:28.919] [request_id=Zrdh2frUYmg0] knowledgebase.go:182[ListKnowledgeBases] | Retrieved knowledge base list successfully, tenant ID: 10000, total: 1 knowledge bases
INFO [2025-09-29 09:36:28.919] []                      | [Zrdh2frUYmg0] 200 | 939 |    3.030019ms | 192.168.172.226 | GET /api/v1/knowledge-bases
INFO [2025-09-29 09:36:28.919] [request_id=t8JaJq82ECDb] tenant.go:84[GetTenantByID] | Start retrieving tenant
INFO [2025-09-29 09:36:28.919] [request_id=t8JaJq82ECDb] tenant.go:91[GetTenantByID] | Retrieving tenant, ID: 10000
INFO [2025-09-29 09:36:28.919] [request_id=eHfeIIE8kt6P] tenant.go:84[GetTenantByID] | Start retrieving tenant
INFO [2025-09-29 09:36:28.919] [request_id=eHfeIIE8kt6P] tenant.go:91[GetTenantByID] | Retrieving tenant, ID: 10000
INFO [2025-09-29 09:36:28.919] [request_id=t8JaJq82ECDb] tenant.go:101[GetTenantByID] | Tenant retrieved successfully, ID: 10000, name: admin's Workspace
INFO [2025-09-29 09:36:28.919] [request_id=eHfeIIE8kt6P] tenant.go:101[GetTenantByID] | Tenant retrieved successfully, ID: 10000, name: admin's Workspace
INFO [2025-09-29 09:36:28.920] [request_id=t8JaJq82ECDb] knowledgebase.go:142[GetKnowledgeBase] | Start retrieving knowledge base
INFO [2025-09-29 09:36:28.920] [request_id=t8JaJq82ECDb] knowledgebase.go:116[validateAndGetKnowledgeBase] | Retrieving knowledge base, ID: 610d3017-0f87-462f-a9cf-b1324c6fbbf4
INFO [2025-09-29 09:36:28.920] [request_id=t8JaJq82ECDb] knowledgebase.go:78[GetKnowledgeBaseByID] | Retrieving knowledge base, ID: 610d3017-0f87-462f-a9cf-b1324c6fbbf4
INFO [2025-09-29 09:36:28.920] [request_id=eHfeIIE8kt6P] knowledge.go:232[ListKnowledge] | Start retrieving knowledge list
INFO [2025-09-29 09:36:28.920] [request_id=eHfeIIE8kt6P] knowledge.go:250[ListKnowledge] | Retrieving knowledge list under knowledge base, knowledge base ID: 610d3017-0f87-462f-a9cf-b1324c6fbbf4, page: 1, page size: 35
INFO [2025-09-29 09:36:28.921] [request_id=t8JaJq82ECDb] knowledgebase.go:88[GetKnowledgeBaseByID] | Knowledge base retrieved successfully, ID: 610d3017-0f87-462f-a9cf-b1324c6fbbf4, name: 测试
INFO [2025-09-29 09:36:28.921] [request_id=t8JaJq82ECDb] knowledgebase.go:151[GetKnowledgeBase] | Retrieved knowledge base successfully, ID: 610d3017-0f87-462f-a9cf-b1324c6fbbf4, name: 测试
INFO [2025-09-29 09:36:28.921] []                      | [t8JaJq82ECDb] 200 | 937 |    4.415835ms | 192.168.172.226 | GET /api/v1/knowledge-bases/610d3017-0f87-462f-a9cf-b1324c6fbbf4
INFO [2025-09-29 09:36:28.923] [request_id=eHfeIIE8kt6P] knowledge.go:261[ListKnowledge] | Knowledge list retrieved successfully, knowledge base ID: 610d3017-0f87-462f-a9cf-b1324c6fbbf4, total: 0
INFO [2025-09-29 09:36:28.923] []                      | [eHfeIIE8kt6P] 200 |  60 |    6.281791ms | 192.168.172.226 | GET /api/v1/knowledge-bases/610d3017-0f87-462f-a9cf-b1324c6fbbf4/knowledge?page=1&page_size=35
INFO [2025-09-29 09:36:28.942] [request_id=zOENBWNCK91o] tenant.go:84[GetTenantByID] | Start retrieving tenant
INFO [2025-09-29 09:36:28.942] [request_id=zOENBWNCK91o] tenant.go:91[GetTenantByID] | Retrieving tenant, ID: 10000
INFO [2025-09-29 09:36:28.942] [request_id=zOENBWNCK91o] tenant.go:101[GetTenantByID] | Tenant retrieved successfully, ID: 10000, name: admin's Workspace
INFO [2025-09-29 09:36:28.942] [request_id=zOENBWNCK91o] session.go:265[GetSessionsByTenant] | Start retrieving all sessions for tenant
DEBUG[2025-09-29 09:36:28.942] [request_id=zOENBWNCK91o] session.go:275[GetSessionsByTenant] | Using pagination parameters: page=1, page_size=30
INFO [2025-09-29 09:36:28.942] [request_id=zOENBWNCK91o] session.go:125[GetPagedSessionsByTenant] | Start retrieving paged sessions for tenant
INFO [2025-09-29 09:36:28.942] [request_id=zOENBWNCK91o] session.go:129[GetPagedSessionsByTenant] | Retrieving paged sessions for tenant, tenant ID: 10000, page: 1, page size: 30
INFO [2025-09-29 09:36:28.945] [request_id=zOENBWNCK91o] session.go:143[GetPagedSessionsByTenant] | Tenant paged sessions retrieved successfully, tenant ID: 10000, total: 1
INFO [2025-09-29 09:36:28.945] [request_id=zOENBWNCK91o] session.go:286[GetSessionsByTenant] | Successfully retrieved tenant sessions, total: 1
INFO [2025-09-29 09:36:28.945] []                      | [zOENBWNCK91o] 200 | 2650 |    4.575175ms | 192.168.172.226 | GET /api/v1/sessions?page=1&page_size=30
INFO [2025-09-29 09:36:52.156] []                      | [15f7a703-7a3c-46cb-b40b-0098118141b1] 200 |  15 |      81.343µs |             ::1 | GET /health
INFO [2025-09-29 09:37:22.228] []                      | [6966d007-f714-4be4-ae90-4608e5c6ec77] 200 |  15 |     139.896µs |             ::1 | GET /health
INFO [2025-09-29 09:37:52.294] []                      | [a1e875d0-e136-492f-8730-beb89e263bf7] 200 |  15 |     145.769µs |             ::1 | GET /health
INFO [2025-09-29 09:38:22.366] []                      | [2aebd584-8c91-43ee-834b-c64b4b886fb3] 200 |  15 |      141.28µs |             ::1 | GET /health
INFO [2025-09-29 09:38:52.433] []                      | [b0132af5-c7bc-4770-ae1e-6cbfee0c302b] 200 |  15 |     166.689µs |             ::1 | GET /health

操作系统

Windows11

确认事项

  • [x] 我已经搜索了现有的 issues，确认这是一个新问题

jlau-ice avatar Sep 29 '25 01:09 jlau-ice

多模态中填的地址并没有实际调用模型，只是ping了一下看是否正常 可以上传个图片，体验一下多模态的模型

begoniezhao avatar Nov 03 '25 07:11 begoniezhao