factool

factool copied to clipboard

It would be great to know the cost estimate prior to running the whole workload

tanay2001

UnicodeDecodeError: 'charmap' codec can't decode byte 0x8f in position 5856: character maps to <undefined>

1

When using the example code I get this error when initializing the Factool object. 

murban-create

EthanC111

Code for claim extraction evaluation

1

Hi! I'm looking for the code you used for calculating ROUGE and BertScore on the RoSE dataset. Is it available by chance? Thanks!

BrMarco99

https://github.com/GAIR-NLP/factool/blob/main/factool/factool.py#L106 For code responses, line 106 might fail.

EthanC111

Error with Factool Installation and Execution

7

Hello, I'm experiencing an error after following the installation guidelines for Factool and using the code from `example.py`. Despite trying both recommended installation methods and ensuring all three API keys...

kentrachmat

How many shots are used for evaluation of HumanEval?

3

Is that 0-shot and 3-shot CoT?

zhimin-z

1. add law counsel qa pipeline 2. update readme for using local chatbots

EQ3A2A

How are the metrics: acc, precision, recall of claim level calculated？

4

How are the acc, precision, recall, and other indicators of claim level calculated? Because the claims extracted from the model are definitely different? It is challenging to calculate indicators without...

LeiyanGithub

pfliu-nlp