qubit55
qubit55
Hello! Ok I see. I have been experimenting with Haskell for data science work and having spark working in an interactive environment such as ghci or jupyter would be extremely...
Hello, are there any updates on the progress?
Ok, I see. I thought that (:pointer pointer-type) was a SBCL-specific feature, so was trying to avoid it.
Btw, awesome work, incredible library. Thank you!
Ah, you are absolutely right, I've completely misread the CFFI documentation on types.
I redefined the struct as: ``` (cffi:defcstruct llmodel-prompt-context (logits (:pointer :float)) (logits-size :size) (tokens (:pointer :int)) (tokens-size :size) (n-past :int) (n-ctx :int) (n-predict :int) (top-k :int) (top-p :float) (min-p :float)...
Another question I have is how to pass null pointers to the logits and tokens fields? My attempt that doesn't work: ``` (make-llmodel-prompt-context :logits (cobj:cobject-pointer (cffi:null-pointer)) :logits-size 0 :tokens (cobj:cobject-pointer...
Getting a type error: ``` Error (SIMPLE-TYPE-ERROR) during printing: # [Condition of type SIMPLE-TYPE-ERROR] ``` Here's the C struct definition if it helps: ``` ;; struct llmodel_prompt_context { ;; float...
Ah, never mind, I've restarted the REPL and everything is working now
Another question I have, do I need to worry about manually freeing up memory when instantiating context or the GC will take care of it automatically?