alexanderchang1
alexanderchang1
Also happening to me.
It looks like the issue is when you specify the apptainer profile, this issue doesn't replicate when you specify singularity profile. Edit: Spoke too soon, same crashing error. FATAL: container...
Hi @jart @stlhood I wanted to follow up to see when the next sync release of llamafile might be available to include this fix on llama.cpp with openai embedding endpoints....
That fixed the pydantic issue, but revealed another issue OpenAI API gets embeddings via POST to this endpoint '/embeddings' (https://platform.openai.com/docs/api-reference/embeddings) But the locally hosted llamafile server gets embeddings via this...
Hi @whitead, Still getting the File Not Found error due to /embeddings and /embedding conflicts in llamafile.
Hi, @whitead i got it to work with the following method. llamafile servers are currently incompatible and result in File Note Found error due to endpoint differences. Instead, a user...
Code to reproduce ``` import numpy as np import pandas as pd import matplotlib.pyplot as plt import torch # Import torch to handle tensors and CUDA devices from contextualized.easy import...
@cnellington re-opening this issue, I'm still having an issue even when I double check the datatype are numpy arrays. I'm trying to isolate if the issue is my input matrices...