lalehsg

Results 10 comments of lalehsg

> > Hi: Is this feature being actively worked on? The downgrade of Llamaindex isn't an option for my project, but I would like to leverage Ragas if possible. >...

Hi all, can anyone help me here? my code worked last week. not running today and throwing the following error: `AttributeError:` 'dict' object has no attribute 'rename_columns ` i am...

Hi all, I have a related issue and would appreciate your help with it. I am working on databricks clusters with no internet connection. I am trying to use databricks...

I tried ``` from ragas.llms import LangchainLLMWrapper dbx_chat = LangchainLLMWrapper(langchain_llm=chat_model) ``` and passed the dbx_chat to the Evaluate and got the same error.

Hi @jjmachan! Thanks so much for getting back to me. Based on the Bedrock example, I was initially hoping that by passing the Databricks model to the Evaluate function, I...

Hi @jjmachan. Regarding the context window size: Let me try to shorten my text then to see if it makes a difference. Regarding your comment about a smaller model: did...

update: So, I tried with much shorter text in the dictionary and the same error happened.

Hi @jjmachan and @shahules786 I have been trying to troubleshoot this a bit. Would like to let you know that from the 3 metrics (context_relevancy, answer_relevancy, and faithfulness) that have...

it happened 2 times in my sample of 18. these were the only cases that llm made up answer without having proper context though. i assume it will happen again...

i actually realized sth. this is probably not Ragas issue. i can avoid confusing the metric by not calling the llm at all when the context is not retrieved and...