Jinbin Fu

dice loss 实现分母为什么没有平方？

1

def dice_loss_func(input, target): smooth = 1. n = input.size(0) iflat = input.view(n, -1) tflat = target.view(n, -1) intersection = (iflat * tflat).sum(1) loss = 1 - ((2. * intersection +...

Custom dataset evaluate OOM

7

When I use this model on custom dataset, it is normal in training phase，but once in evaluation phase, it's always encountering out of memory for GPU. What's the possible reason...

使用 fp16 训练，merge lora 之后的模型推理结果异常

5

### System Info / 系統信息 版本及硬件按照指示安装 ### Who can help? / 谁可以帮助到您？ @1049451037 ### Information / 问题信息 - [X] The official example scripts / 官方的示例脚本 - [ ] My own...

huggingface model how to convert to SAT model

5

### Feature request / 功能建议 how to convert huggingface model convert to SAT model? ### Motivation / 动机 So can use sat to train V2 faster. ### Your contribution /...

transformer.word_embeddings 在代码中的功能是计算最开始将token id转成embedding，最后输出计算token的feature相似度 lm_head呢？没找到具体的使用位置