zhouchang123

how to deal with the problem ,

1


[UPRISE}When use llm to score the prompt,the connection stopped.

4

When use llm to score the prompt,the connection stopped.Thus the files are not complete. Can I operate a new same order to continue score the prompts? 

[UPRISE]What is the use of some keys in hellaswag and copa?

2

What is the use of some keys in hellaswag and copa? For example: copa:{ "premise": "The woman filed a restraining order against the man.", "choice1": "The man called her.", "choice2":...

[UPRISE]After rereading the paper UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation,I have some questions.

13

 1.How to get the scores through GPT-Neo-2.7B? 2.In which procedure,the prompt get positive or negative,after get the scores or after encode before score?

[LLM_RETRIEVER]Some questions about the papar of llm_retriever .

2

Q1:The paper said BM25 Retriever is the initial model.Do you mean use the cross-encoder is used to tune BM25 retriever? Q2:In Section 4.2 what's the function of s(x,y,xi,yi)?In Section 4.3...