Lai Wei

fix dataloder len

6

fix #1390

Error msg: ``` [NbConvertApp] Converting notebook chapter_convolutional-neural-networks/lenet.ipynb to html Nov 16, 2020 7:31:39 PM io.github.spencerpark.jupyter.channels.Loop start INFO: Loop starting... Nov 16, 2020 7:31:39 PM io.github.spencerpark.jupyter.channels.Loop start INFO: Loop started. Nov...

SM library telemetry improvement

2

* add segfault error attribution * in creased failure reason limit to 8k(WIP at SM side, no total limit on SMTT side) * limit error message part of failure reason...

Hi MetaSeq team, Is there any plan to enable flash attn by default, I found by enabling it the WPS from benchmarking almost doubled. I came across this PR https://github.com/facebookresearch/metaseq/pull/387...

hi, I ran inference on half of the problems using gpt-4 (bm25-27k setting), sharing my results here if this can be useful. Awesome project! https://drive.google.com/file/d/1Q9AX4zgOKDLMrXlKvBJ4e5qJtbtPW3aP/view?usp=sharing

failed to run inference on 3.2 11B vision model

2

Hi, I'm trying to run inference on 11B vision model but faced this error running the client. I was able to download, build, config and run the server without issue....

*Issue #, if available:* *Description of changes:* 1. Fixed image pull policy config, to resolve this error during deployment ``` Error from server (BadRequest): error when creating "nccl-tests.yaml": MPIJob in...

add support for llama vision model conversion

2

# What does this PR do? Updated the script to support converting finetuned llama 3.2 vision model to HF format, so it works with multimodal inference. ## Feature/Issue validation/testing Tested...