SeungJun

Should I freeze norm.weight?

1

Llama base model has `norm.weight`. Did you also freeze norm.weight when post-training? ``` "model.layers.9.self_attn.k_proj.weight": "model-00001-of-00004.safetensors", "model.layers.9.self_attn.o_proj.weight": "model-00001-of-00004.safetensors", "model.layers.9.self_attn.q_proj.weight": "model-00001-of-00004.safetensors", "model.layers.9.self_attn.v_proj.weight": "model-00001-of-00004.safetensors", "model.norm.weight": "model-00004-of-00004.safetensors" ```

Performance Issue with return_context_logits Enabled in TensorRT-LLM

1

### System Info Intel(R) Xeon(R) CPU @ 2.20GHz Architecture: x86_64 NVIDIA A100-SXM4-40G Ubuntu ### Who can help? _No response_ ### Information - [X] The official example scripts - [X] My...

Add KoCommonGEN v2 benchmark

4

Description: This PR adds support for the KoCommonGEN v2 benchmark, a new dataset for evaluating Korean commonsense reasoning in large language models. Changes: - Added KoCommonGEN v2 task definition -...

Supports for Korean BertScore

1

# Korean BertScore Implementation of BERTScore for Korean text generation evaluation. ## Key Features - Support for Korean-optimized pre-trained models - kykim/electra-kor-base - monologg/koelectra-base-v3-discriminator - beomi/KcELECTRA-base - Support for other...