DB-GPT icon indicating copy to clipboard operation
DB-GPT copied to clipboard

Questions About Experience Handling and Search in the Knowledge Base

Open andyyosshi opened this issue 1 year ago • 2 comments

I have some questions regarding Experience.

Currently, for each expert's Experience located in /knowledge_base/, there seem to be some Experiences that include variables within them. For example, "cause_name": "insert_large_data" has a variable like "inserted_tuples_threshold" within its "desc".

  • Are these variables parsed somewhere so that the system is designed to let the expert determine real values?

Additionally, I understand that abnormal_metrics names are used to search for Experiences stored in the Chroma DB. Could you clarify which parts of the Experience are used in the search? Is it the cause_name, desc, steps, or metrics?

Thank you for your assistance.

andyyosshi avatar Jun 10 '24 05:06 andyyosshi

Sorry for the delayed reply!

  1. We match experiences using the "metrics" attribute, which is saved as the index ("pg_content") in Chromadb by default.

  2. The actual metric values is appended outside the experience, which are generally not exact caused by approximate matching.

image

XuanheZhou avatar Jun 13 '24 03:06 XuanheZhou

Thank you for the clarification!

To ensure I understand correctly, the "metrics" attribute of an Experience is the primary component used for matching within Chroma DB. However, the actual metric values appended outside the Experience may not be exact due to approximate matching.

Could you also provide some insights on how the variables within the "desc" attribute of an Experience, such as "inserted_tuples_threshold", are handled? Are these variables dynamically evaluated by the system or the expert?

Thank you once again for your assistance.

andyyosshi avatar Jun 17 '24 00:06 andyyosshi