akamaster

[Oops.] Footnote on page 327 is not complete (missing ending)

1

**Chapter number or note title:** 10. Maximum Flows & MInimum Cuts **Page number:** 327 **Error description:** footnote is not complete, current text is the following: > I learned this story...

additional details on ResNet20 (low rank)

4

Would you please share speed up ratios and final ranks on ResNet20 (CIFAR) obtained in Coordinating Filters for Faster Deep Neural Networks paper?

[BUG] Incorrect logits on Bloom models

2

**Describe the bug** DeepSpeed(DS) optimized bloom model inference produces incorrect logits hurting overall model accuracy. Numerical differences on final logits for the phrase "This is test" when compared to pure...

[BUG] Wrong logits/outputs when using HFOPTLayerPolicy on OPT model

1

**Describe the bug** DeepSpeed optimized OPT inference produces garbage if using HFOPTLayerPolicy for kernel injection. Below are the results of l2 and l1 difference when HFOPTLayerPolicy is used vs. when...

[BUG] Incorrect logits/loss/outputs on GPT-NEOX-20B

2

**Describe the bug** DeepSpeed(DS) optimized GPT-NEOX-20B model produces incorrect logits and loss, which hurts overall model accuracy. Numerical differences on final logits for a test phrase (see code) is as...