Prompt-BERT

Prompt-BERT copied to clipboard

Questions about the paper.

8

Hello, I was very fortunate to read your paper, and the experimental results are exciting. The paper mentions two observations: Observation 1: Original BERT layers fail to improve the performance....

chaochen99

RuntimeError: cosine_similarity requires both inputs to have the same sizes, but x1 has [128, 1, 768] and x2 has [1, 128, 768]

1


zhaijianyang

Hi~ 感谢你们的开源工作 #32 中已经指出对于 PyTorch 2+，应该修改 `run.sh` 中的脚本，由 `python -m torch.distributed.launch` => `torchrun` ```.sh "sup-bert") # BC=(python -m torch.distributed.launch --nproc_per_node 4 train.py) BC=(torchrun --nproc_per_node 4 train.py) TRAIN_FILE=data/nli_for_simcse.csv BATCH=128 EPOCH=3 LR=5e-5...

Anonymous-AI1