DExperts

DExperts copied to clipboard

Problems when generate continuations

2

Hi! I try to generate continuations with DExperts using the following scrpit. ```bash OUTPUT_DIR=output/toxicity/dexperts PROMPTS_DATASET=prompts/nontoxic_prompts-10k.jsonl MODEL_DIR=models/experts/toxicity/large API_RATE=25 export CUDA_VISIBLE_DEVICES=6 python -m scripts.run_toxicity_experiment \ --use-dataset \ --dataset-file $PROMPTS_DATASET \ --model-type dexperts...

richard-peng-xia

Hello! I have read your paper and have a question about how to judge an expert or anti-expert is good or not. Your paper says that for sentiment control you...

tqzhong

Hi, I'm curious about the intuition to include or not include prompts during evaluation. In your toxicity evaluation, only the generated sequence is evaluated. However, in your sentiment evaluation, prompts...

haikangdeng