nilsec comments

Repositories
Issues
Comments

Results 4 comments of


                                            nilsec

model's maximum context length

Same, with Character Text Splitter. Without having looked at the source, my hunch is that the chunking seems to only use the chunk size as a reference but actually chunks...

[BUG] Deepspeed Zero 3 Inference InFlight Params with new HuggingFace Mixtral Model

Any update on this?

MPSNDArray.mm:782: failed assertion; bufer is not large enough Mac M1 MPS

Same here > /AppleInternal/Library/BuildRoots/20d6c351-ee94-11ec-bcaf-7247572f23b4/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Types/MPSNDArray.mm:782: failed assertion `[MPSNDArray, initWithBuffer:descriptor:] Error: buffer is not large enough. Must be 292280 bytes

Implement Maximal Update Parametrization (muP)

Curious too, any news?