RefChecker

RefChecker copied to clipboard

How to run the demo on a machine with no NVIDIA GPUs?

1

Hello, I was trying to use your repo for some fact checking tasks. I followed the quick start guide, but when I want to use the demo app (`demo/main.py`), it...

saeednj

The Checker.check function in line 221 fails in the cli.py. The most likely reason is that the triples list in not in the correct format. A possible solution is to...

vinayvarahabhotla

Hi, It was a nice article to read about detecting hallucination via generating triplets from the summary and then checking the same against the reference from which the summary was...

pradeepiisc

Macbook M1 chip - dependency install issues

1

I have a macbook: **M1** chip: I am getting this error, when I run the command ```bash pip install -e . python -m spacy download en_core_web_sm ``` **Error message:** ```bash...

moyarich

Ask a few questions about RefChecker and webside RefChecker Demo

11

1、a command-line interface to run RefChecker in a console: refchecker-cli extract \ --input_path example/example_in.json \ --output_path example/example_out_triplets.json \ --extractor_name claude2 \ --extractor_max_new_tokens 1000 \ --anthropic_key "example/anthropic_key" #I've already applied the...

Romanzhang2024

*Description of changes:* - More arguments controlling the params for locally deployed LLM (Currently Mistral/Mixtral) - Corrected prompt for Mistral (to avoid truncations) - API optimization By submitting this pull...

void-b583x2-NULL

Logic for merging checker

2

Hi there, I see when you're merging in your `CheckerBase` you take 'Entailment' as a precedence? https://github.com/amazon-science/RefChecker/blob/64e7c34b5fd4f6af7a5227473458619a3d92ad5b/refchecker/checker/checker_base.py#L6C1-L23C21 I see there is a TODO there, but I'd have thought maybe the...

Padarn

Link "hallucination checker" Do Not Exist

1

Hi, there is a missing link in the introduction: "[hallucination checker](https://github.com/amazon-science/RefChecker/tree/main/RefChecker/checker)"

Southpika

Deprecation issue with latest Transformers

1

Facing the following issue regarding AdamW being removed from transformers in version 4.50 onwards I believe. The last transformers version compatible with ragchecker is 4.49 at present. It would be...

AbhilashPal

*Issue #, if available:* *Description of changes:* Update the version of the [`anthropic` python library](https://pypi.org/project/anthropic/) to be more up to date. By submitting this pull request, I confirm that you...

brynnjmccormick