ARIELDENG

使用SFT后的FP32模型进行生成，报错RuntimeError: where expected condition to be a boolean tensor, but got a tensor with dtype Half

4


format for inference in code completion

6

starcoder's format for inference in code completion is PSM, + prefix + + suffix + what's that for starcoder2? from the paper, we could only see that