sadaf0714

Results 13 comments of sadaf0714

I have checked and all of this is fine. Can you please suggest why it i not extracting context relevance and groundedness metrics while i am getting answer relevance fine.

Sure here's the code: tru = Tru() tru.reset_database() os.environ["HUGGINGFACE_API_KEY"] = hf_token provider = LiteLLM(model_engine="huggingface/mistralai/Mistral-7B-Instruct-v0.2") f_qa_relevance = Feedback( provider.relevance_with_cot_reasons, name="Answer Relevance" ).on_input_output() f_context_relevance = ( Feedback( provider.qs_relevance_with_cot_reasons, name="Context Relevance", ) .on(Select.RecordCalls.retrieve.args.query)...

please find the full notebook attached. [https://github.com/sadaf0714/trulens/blob/main/TruLens_langchain.ipynb](url)

https://github.com/sadaf0714/trulens @joshreini1 please try with this

![image](https://github.com/truera/trulens/assets/123365493/3aacc70f-abfd-4319-9d27-49edec535cfe) This is the error snapshot.

this is how i created feedback metrices f_qa_relevance = Feedback( provider.relevance_with_cot_reasons, name="Answer Relevance" ).on_input_output() query = Select.Record.app.retriever._get_relevant_documents.args.query context = Select.Record.app.retriever.get_relevant_documents.rets[:].page_content f_context_relevance = ( Feedback( provider.qs_relevance_with_cot_reasons, name="Context Relevance", ) .on(query) .on(context)...

> @sadaf0714 could you please tell me how can I fix it. ![KakaoTalk_20240603_181240684](https://private-user-images.githubusercontent.com/127589724/336011266-38b13e4b-b9ae-4b05-9005-2d376c5f791e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTc0MDY0MzIsIm5iZiI6MTcxNzQwNjEzMiwicGF0aCI6Ii8xMjc1ODk3MjQvMzM2MDExMjY2LTM4YjEzZTRiLWI5YWUtNGIwNS05MDA1LTJkMzc2YzVmNzkxZS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjAzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYwM1QwOTE1MzJaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0xMGVhMTA5ZmQ1YzUyMzg1NDdmZWI4NmYwNWNiYzllM2IyOTdkMzI2ZmI2ZGRhZTY5MTRmZGU5NWE5NjM2YmM2JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.L9CFlZhmJidz-s83o_eGp1nT0XQpVjfiJ-wgdUJoOYg) > > also plz check ![image](https://private-user-images.githubusercontent.com/127589724/336012023-5523ad01-8b90-447d-95db-eff26aeab51c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTc0MDY0MzIsIm5iZiI6MTcxNzQwNjEzMiwicGF0aCI6Ii8xMjc1ODk3MjQvMzM2MDEyMDIzLTU1MjNhZDAxLThiOTAtNDQ3ZC05NWRiLWVmZjI2YWVhYjUxYy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNjAzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDYwM1QwOTE1MzJaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0yYzU0Mzk1OGZkNjU0ZjlhNzUyNTczMTg1NGI5ZTFmMzQyOWEzNWViMDk4YzY0NWY4MWYyY2JkZjQ1MDUzNmJmJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.OE4mIvANPNzYEnaW_sX-APL64zLW_xmtpcwQSziof-M) import it like this: from trulens_eval import Feedback, LiteLLM, TruLlama, Select,...

Hi, for now can you please tell me what will be the retrieval queries to be used in place of hc_retrievalquery and vc_retrievalquery so that it generates proper results. The...