whisper.cpp icon indicating copy to clipboard operation
whisper.cpp copied to clipboard

go bindings: allow use of the use_gpu and flash_attn options

Open AnyCPU opened this issue 5 months ago • 0 comments

This pr allows use of the model options in Go bindings: use_gpu and flash_attn.

So if you are lucky man and you work on macOS (Intel) then you could write following:

	model, err := whisper.New("../../models/ggml-base.bin", whisper.WithUseGPU(false))
	if err != nil {
		slog.Error("error initializing a whisper model", "error", err)
		return
	}

AnyCPU avatar Sep 16 '25 22:09 AnyCPU