suolyer

how to split single-triplet and multi-triplet

1

hi~, nice work I have some question. how to get the single-triplet dataset and multi-triplet dataset？ Why is the accuracy rate used for single-triplet instead of F1? The model may...

the label of WSC task is all true?

1

the label of WSC task is all true，no false

Uses bf16 training, there is an abnormal loss[BUG]

1

**Describe the bug** I use the [neox framework](https://github.com/EleutherAI/gpt-neox) to load the weight of llama to continue training. When I use bf16, the loss becomes very large after the weight is...

**Describe the bug** I use the following configuration to enable bf16 ```json "precision": "bfloat16", "bf16": { "enabled": true }, ``` When loading llama's weights and training, I get abnormal lm_loss...