kernel-memory icon indicating copy to clipboard operation
kernel-memory copied to clipboard

Expose Partition "Link" to lookup document snippet

Open crickman opened this issue 2 years ago • 2 comments

The existing Citation.Link refers to the entire logical document. We also would like to lookup the specific citation partition text, not just the entire document.

Could the Citiation.Partition also expose a Link property?

crickman avatar Sep 01 '23 16:09 crickman

The citation includes the partition text, perhaps you mean exposing a link to the "file" in case the document contains multiple files?

image

There are a bunch of operations to enable on files, e.g. fetch, append, delete. I'll update the backlog. Append is the most urgent for chat memory, once that's designed the other operations should be easy to follow.

dluc avatar Sep 02 '23 00:09 dluc

We'd like to achieve the same thing as @crickman (I think). The documents we ingest are typically 100s of pages long. In these cases, it isn't that useful to say to the user "hey, the citation for this answer is somewhere in this large document.". It's more convincing/reassuring/compelling to say to the user "It's in source file X , on page 46". Appreciate we might not be able to give the exact page as chunks are likely to span pages, but even pointing the user at the start of the chunk in the source file would be enough I think.

@crickman , if this was not want you meant in your original question, apologies and let me know and I will raise a separate request. @dluc - keep up the great work! Thanks!

slm-2015 avatar Oct 23 '23 09:10 slm-2015

Download link added. About adding a page number the text extractor will need to be rewritten to capture metadata. Please feel free to use the poll at https://github.com/microsoft/kernel-memory/discussions/532 to vote for this feature

dluc avatar Jun 04 '24 19:06 dluc