SPTAG

SPTAG copied to clipboard

How could SPANN load DEEP-1B (358GB) into memory with only 128GB RAM (in SPANN paper)?

7

Hi, I'm reading the source code and paper of SPANN. In `/AnnService/src/IndexBuilder/main.cpp`, we can see data will be loaded in function `DefaultVectorReader::GetVectorSet()`. In that function, vectors are loaded in one...

matchyc

Add nni_auto_tune example

2

Add nni_auto_tune examples for sift and glove100.

smallv0221

MaggieQi

add tools for opq training and inference

1

added one additional Readme script, if other command script is needed let me know.

jinwei14

PhilipBAdams

test failure when building on Linux in tmpfs due to the use of `O_DIRECT`

1

When building SPTAG on Linux in a tmpfs (a RAM-only filesystem), the tests fail because they open files with `O_DIRECT` but that [isn't supported](https://lore.kernel.org/lkml/[email protected]/t/) on tmpfs by current versions of...

pabs3

Print file open error information

2

Should help diagnose the build failures in Debian. Fixes: https://github.com/microsoft/SPTAG/issues/327

pabs3

print reason for file handle creation failure

1

In [AsyncFileReader.h](https://github.com/microsoft/SPTAG/blob/main/AnnService/inc/Helper/AsyncFileReader.h) class `AsyncFileIO` function `Initialize`, it handles failure to open the file by printing an error saying that the file handle couldn't be created, but it doesn't print the...

pabs3

could not find MPI_C MPI_CXX MPI ... during cmake -A x64 ..

1

**Describe the bug** followed the steps in here https://github.com/microsoft/SPTAG/blob/main/docs/WindowsInstallation.md but still got an error cmake version 3.24.0-rc1 boost == 1.67.0 SWIG Version 4.0.2 **To Reproduce** Steps to reproduce the behavior:...

jinwei14

Added AARCH64 support

5

This pull request would allow for AARCH64 support. I made sure the ./test executable can run without error on an arm docker. The only thing I am unsure of is...

mcelhennyi