hechengbo-H

When I run deferral_generation.sh, a file seems to be missing. 

I followed your instructions, but the issue remains unresolved. First, I ran the following command (# n_shot=1 -> n_shot=0 ) `python collm/dataset/formatting.py --dataset-name gsm --output-path static_eval-completion --output-name gsm-0shot` The result...

Hi, I've encountered a new issue. When I run the command: `python collm/generate.py deferral_threshold_search --dataset "/space/hecb/co-llm-main/static_eval-completion/gsm-0shot/validation" --save_path "/space/hecb/co-llm-main/checkpoints/generate/gsm8k-finetuned/gsm-0shot/gsm8k-def-finetuned-Llama-2-7b+EleutherAI@llemma_7b/" --num_proc 8 --max_tokens 512 --base_model_port 9601 --ref_model_port 9600 --batch_gen_port 8003 --n_samples_for_search 15...

After solving the network problem, I encountered a new problem. 

Hello, I followed the steps in your `readme.md` file, but encountered some issues. Here's a detailed breakdown of what I did: ***Data Processing*** **Step 1: Format the dataset** ```bash python...

Thank you very much for your reply! I think I finally got through the readme! Of course, I have a few questions to ask. Hahaha 1. As you mentioned, the...