Sergey Mkrtchyan comments

Repositories
Issues
Comments

Results 5 comments of


                                            Sergey Mkrtchyan

AutoFileName doesn't work with babel syntax

NodeJS "require" doesn't seem to trigger it either.

Tensorboard starting but not showing scalars when used on AWS Sagemaker

Facing the same issue with tensorboard 2.11.0 and Werkzeug 2.2.2 on AWS Sagemaker.

Fix a mis-aligned else that causes a crash

Github does not render the diff correctly, unfortunately, but the fix is correct. You can copy the diff into a text editor and see the difference.

How can I merge the LoRA weights into the base model?

You can do something like this ``` from mistral_inference.model import Transformer model = Transformer.from_folder(args.model_path, device=f"cuda:0") model.load_lora("/path/to/lora.safetensors", device=f"cuda:0") safetensors.torch.save_model(model, "/path/to/merged.safetensors") ```

Crash fix due to inconsistent use of tabs and spaces

There is a PR open already for this: https://github.com/mistralai/mistral-finetune/pull/91