mph

mph copied to clipboard

Builder & mmap

3

A major motivation for using mmap'ed files is whe the data-set does not fit in the memory. Currently, the builder uses a lot of memory. It would be great to...

raichu

Lower go.mod version to Go 1.17

1

This library can actually run with a really old Go version, but 1.17 seemed old enough to include most installations.

Jille

Integer key and value

7

It seems mph essentially implements a `map[[]byte][]byte`. Is it possible to change the code such that it becomes `map[uint32][]uint8`? Go's bulit-in map has just too much overhead for my application...

raichu

key/value Iteration starting from 1 minhash value

1

It probably must start from 0? one key and value which is at 0 is always missed when using iterator correction: iterator interface is a bit confusing, right pattern of...

vseledkin

Build fails if key count is a power of two

1

``` func TestCHD_Pow2(t *testing.T) { check := func(n int) (err error) { cb := Builder() for i:=0; i

akaspin

Best ways to handle failure to find a collision-free hash

4

(I apologize if this is out of scope for this library, and for my relatively shallow understanding of MPHs.) Using the FNV hash func and even some simple inputs (e.g.,...

sqs

I'm using this to get the byte-for-byte same result if the input is the same, so my rsync-like tool doesn't need to retransmit the data. also switch to `rand.Uint64()` which...

Jille