chensimian

No module named 'colossalai.kernel.op_builder'

1

### 🐛 Describe the bug When I rune llama2 exampLe here are some errors, how should I solve it ? The previous issue was not helpful to me and I...

[BUG]: On the eight-card A100, testing the 'examples/language/llama2' with the 'gemini_auto' plugin resulted in an 'out of memory' error."

1

### 🐛 Describe the bug Here are my script, it can run with hybrid_parallel plugin, but other plugins have the same error "out of memory" torchrun --standalone --nproc_per_node 8 finetune.py...

Gemini_auto error

1

### 🐛 Describe the bug When I enable the optimization options inside the gemini_auto plugin, I encounter errors, such as TypeError: GeminiPlugin.init() got an unexpected keyword argument 'enable_flash_attention'. ### Environment...

when I uese hybrid_parallel, and set the enable_fused_normalization = True. I can't run the code, here are some error: RuntimeError: Failed to replace input_layernorm of type LlamaRMSNorm with FusedRMSNorm with the exception: Please install apex from source (https://github.com/NVIDIA/apex) to use the fused RMS normalization kernel. Please check your model configuration or sharding policy, you can set up an issue for us to help you as well. However, I have install the apex, it will still occur. How can i solve it?

9

### 🐛 Describe the bug raise RuntimeError( RuntimeError: Failed to replace input_layernorm of type LlamaRMSNorm with FusedRMSNorm with the exception: Please install apex from source (https://github.com/NVIDIA/apex) to use the fused...

prompt_optimization

2

The dataset for prompt optimization should consist of four, but the source code only provides two. Is there a missing part?

The PDF cannot detect images or convert them to Markdown format

1

The FastAPI interface's image recognition is very very inaccurate！！！！！, and it cannot replace images in their original positions in a PDF document with Markdown image format. Can this issue be...