Sascha Rogmann

ENH: Addition of optional visitor-functions in extract_text()

10

This request contains the addition of optional visitor-callbacks in extract_text(). While scanning the text-objects of a page _extract_text() calls these visitor-methods. So one can analyze the operations in the page...

ENH: Added command update-offsets to adjust offsets and lengths.

1

This command adjusts /Length-entries of stream objects and the xref-offsets in simple PDF files (ASCII only, one xref section only) to support writing PDF files by means of a text...

Implementation of Q6_KFloatTensor

2

This PR contains a Q6_K implementation. * Model: bartowski/Meta-Llama-3.1-8B-Instruct-GGUF, Q6_K * CPU: AMD Ryzen 9 7900X * JVM: OpenJDK 64-Bit Server VM * Linux: 6.9.7-arch1-1 | Quant | Species |...

Implementation of Phi-3-mini-4k-instruct (Q8_0 or Q4_0).

14

This is a PR to run Phi-3-Mini-4K. It only includes `Phi3.java`. I wrote this file because phi-3 is faster at simple tasks. I intentionally left `Llama3.java` unchanged, even though some...

Support for split UTF-8 sequences

3

Hi @mukel, I like your Llama3 implementation using the Vector API. Here is a pull request to handle split UTF-8 sequences. An example is the prompt "How to write 'three...

Added reading and writing of a state-cache

2

This PR contains an exemplary implementation for storing the computed states of a system-prompt on disk. I wrote this implementation a few weeks ago, so it may not be mergeable...

Added llama.cpp-compatible http-server.

1

This PR contains a llama.cpp-compatible HTTP-server using the HTTP-server of the JDK. In my tests I used the HTML- and JS-resources of llama.cpp. I wrote this implementation a few weeks...