implicit_chain_of_thought
implicit_chain_of_thought copied to clipboard
da03
Hello, Thanks for your nice repo. I noticed that MIXTURE_SIZE is set to 1 in your provided example command. `self.mixture_components = nn.Embedding(config.mixture_size, hidden_size)` I feel curious why mixture_size is not...
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1!
Researchers usually download the huggingface transformers model to local storage to avoid errors when they don't have a stable network connection. When using training or inference script, SSL error or...
This is the minimal code change to answer Prof. @da03 challenge. for adding the teacher states , I had a function called add_two_teacher_states on **line 57**. Although I believe compressing...
1. Resolve a warning caused by a missing logging method. 2. Fix a typo "positions_to_substitut" that still exists. Hi, Prof. Deng. I am creating this pull request to bring your...
Hello, I am currently try to reproduce the explicit CoT result from your paper, but realized that I need natural language intermediate steps for training GPT-2 for explicit CoT. Do...
In the provided code, I can see that MSELoss is used, but I don't see the term $log P(c_l = z_{t_l})$ being included. However, in the explanation of the loss...
Do you have any plans to share the code you used to create the 4by4 mult, 5by5 mult? Thanks in advance for your response.
Hello! Your paper about ICoT impressed me. However, when I tried to reproduct the code, I faced one challenge: Here is the code in file `generate.py`, lines 58-71: ``` for...
