kendiyang

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

2

new version of transfomer, no need to use BetterTransformer, try setting attn impl to sdpa... attn imp: Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in . running...

go-cache-lru not found bug

2

go: github.com/Jigsaw-Code/outline-sdk/x/psiphon imports github.com/Psiphon-Labs/psiphon-tunnel-core/ClientLibrary/clientlib imports github.com/Psiphon-Labs/psiphon-tunnel-core/psiphon imports github.com/cognusion/go-cache-lru: github.com/cognusion/[email protected]: invalid version: git ls-remote -q origin in /go/pkg/mod/cache/vcs/667476c16c5dcef6694580cdd309feb30e49715dc592212645fcea30991ba598: exit status 128: remote: Repository not found.

from txtai.pipeline import HFOnnx # 模型路径 path = "openai/whisper-small" # 将模型导出为 ONNX onnx = HFOnnx() model = onnx(path, "default", "whisper-small.onnx", True) Traceback (most recent call last): File "/root/test.py", line 8,...

1.optimum-cli export onnx --model openai/whisper-small onnx_model/ --monolith 2.optimum-cli onnxruntime quantize --onnx_model onnx_model/ --arm64 -o quauntized_model/ E/[OrtWhisper.kt]( 6184): Error in getTranscription: Error code - ORT_NOT_IMPLEMENTED - message: Could not find an...