Genkagaku.GPT
Genkagaku.GPT
Hi, here is an edited version which supports typescript and mobx 4, can be installed via npm https://github.com/hlhr202/mobx-remotedev
Hey checkout the example here https://github.com/hlhr202/FlutterStatePOC
Hi, I would like to add llama.cpp PR here for reference. just noticed they merged the embedding function https://github.com/ggerganov/llama.cpp/pull/282/files
> Hi @hlhr202! 👋 > > Thanks for bringing this to our attention. The code here doesn't look hard at all to port! We will add it to the repo...
> Please check out #72. I implemented some code to extract embeddings, but we still need to validate if the results are correct, and how to best expose this to...
It seems llama.cpp have not done embeddings yet. I try to print the embedding vectors, but got size 0.
@setzer22 sorry I reopened this ticket cuz I have noticed some changes from llama.cpp. And still I have tested a few examples on 7B alpaca but the results not very...
> @setzer22 I think our llama-rs implementation for embeddings may not be correct. what I v noticed from llama.cpp is that they were not using any end token as representation...
> LGTM once the other review feedback's sorted out. > > For exposing it from the CLI, I'm not sure... people _might_ use it as a process in a CLI...
> @hlhr202 The CLI is just a consumer of the library crate, so when using the library you'll be able to get the embeddings. yes absolutely, cuz i m porting...