llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard
Published 3 months ago • verified publisher icon ggml-org

Perplexity during inference

Open Luigi-Ottoboni opened this issue 1 year ago • 0 comments

How can I measure the perplexity of a specific prompt/answer during the inference ?

Luigi-Ottoboni avatar Mar 22 '24 15:03 Luigi-Ottoboni