language-model-arithmetic

language-model-arithmetic copied to clipboard

How to use from Windows

1

I am using the Windows platform to use this project. How to debug it? My pychart cannot import ModelArithmetic, Evaluation, PromotedLLM, Max, Classifier, Min, enable_logging when using Scripts scripts

fireyanci

Can this methodology be applied to closed-source large-scale models such as chatgpt?

3

Can this methodology be applied to closed-source large-scale models such as chatgpt?

dongshenggu

advice -> advise

eltociear

Some questions about custom model loading

2

Does it only accept loading open source models from Huggingface? What if I want to use the LLM api provided by other platforms, such as the api provided by SiliconFlow,...

ChangtiWu

SPECULATIVE SAMPLING

4

Hello, I would like to ask why p2 needs to be corrected after the sampling is rejected, instead of directly using p2?

sdzhaojingyu

Inference acceleration

1

Excellent work. I would like to know if it is possible to use some commonly used inference acceleration frameworks such as VLLM and LMDEPLOY in the model loading section.

CQUPT-CaiKe