Mary Trofimova comments

Results 3 comments of


                                            Mary Trofimova

Create a Trainer class for learning rate scheduling

LRScheduledModel performs - learning rate and momentum updating - fitting of learning rate on a small subset of data (before main phase of training), see [LRScheduledModel.fit](https://github.com/deepmipt/DeepPavlov/blob/613d265f7371ba05365a7d44485066293c169674/deeppavlov/core/models/lr_scheduled_model.py#L294) for details.

faiss::gpu::runMatrixMult ... cublas failed (13): (1024, 12) x (256, 12)' = (1024, 256) gemm params m 256 n 1024 k 12 trA T trB N lda 12 ldb 12 ldc 256

It helped me to install a specific wheel with faiss-gpu==1.7.3: `pip install https://github.com/kyamagu/faiss-wheels/releases/download/v1.7.3/faiss_gpu-1.7.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl`

[Bug]: Can't use yarn rope config for long context in Qwen2 model

Changing key from `type` to `rope_type` doesn't remove warning for me, I'm using `vllm==v0.7.3` and `transformers==4.45.1` To my understanding this warning doesn't influence yarn computation in vllm. It is a...