Z-oo883

why is answer_relevancy always 0？

5

environment： python 3.9.20 datasets 3.0.1 langchain 0.3.3 langchain-community 0.3.2 langchain-core 0.3.10 langchain-openai 0.2.2 langchain-text-splitters 0.3.0 ragas 0.0.22 code: from langchain_community.chat_models import ChatOpenAI from langchain.prompts.chat import ChatPromptTemplate, SystemMessagePromptTemplate, HumanMessagePromptTemplate, \ MessagesPlaceholder...

RuntimeError: Task <Task pending name='Task-61' coro=<as_completed.<locals>.sema_coro() running at D:\anaconda\envs\bge\lib\site-packages\ragas\executor.py:33> cb=[as_completed.<locals>._on_completion() at D:\

4

python3.9.19 ; ragas 0.1.21 code: ```py from langchain_community.document_loaders import DirectoryLoader from ragas.testset.generator import TestsetGenerator from ragas.testset.evolutions import simple, reasoning, multi_context from langchain_openai import ChatOpenAI, OpenAIEmbeddings from langchain.embeddings import HuggingFaceEmbeddings loader...

pydantic.v1.error_wrappers.ValidationError: 2 validation errors for DataRow

3

code: ```py from langchain_community.document_loaders import DirectoryLoader from ragas import run_config from ragas.executor import Executor from ragas.testset.generator import TestsetGenerator from ragas.testset.evolutions import simple, reasoning, multi_context from langchain_openai import ChatOpenAI, OpenAIEmbeddings from...

when use ragas0.2, unable to apply transformation: Connection error

5

when I try to use ragas0.2, I have encountered a problem：unable to apply transformation: Connection error，what shoud I do to deal with it? **enviroment:** ragas=0.2,python=3.9 **code**: ```py from langchain.document_loaders import...

unable to apply transformation: 'headlines' property not found in this node

1

**Your Question** What should I do when I encountered these errors when generating test data in a non English language? **Code Examples** ```from langchain_community.document_loaders import DirectoryLoader, TextLoader from ragas.llms import...