RAIN

RAIN copied to clipboard

issue: how to set max_new_tokens ?

3

how to set max_new_tokens? I just could find 'maxlen' var in 'main.py', and it would cost too muck time for testing.

Dada-Cloudzxy

AdvBench (GCG): `text = text[inds[4]:]` runs into `IndexError: list index out of range`

1

Thanks for your code! I am reaching out to discuss some observations I've made while utilizing your codebase. When executing the code snippet provided below, an error occurs and the...

shanpoyang654

test on HH-RLHF

2

I see the code and find that in the HH-RLHF dataset you use the red-team data for test. I want to know how the test scores are calculated? I didnt...

LoverLost

Thanks for your great work. I want to apply RAIN to Mistral ([https://huggingface.co/HuggingFaceH4/mistral-7b-sft-beta]) on HH test set. I only changed scripts of loading dataset in `main.py` (I want inference on...

skepsun

when I run HH/main.py with the following setting: parser.add_argument('--modelname', type=str, default="./models/vicuna-7b-v1.5") I get an error: for epoch_test, batch_test in tqdm(enumerate(testloader)): Exception has occurred: RuntimeError stack expects each tensor to be...

Francisapzii