Simple-kNN-Gzip
Simple-kNN-Gzip copied to clipboard
Fast Simple Parallel Gzip NCD Calculation
Refactored code to improve performance and readability
- Using the joblib.Parallel library to parallelize the computation of the NCD matrix.
- Simpler logic for NCD calculation
- Removing unnecessary comments and improving the formatting of the code.
- tested code speed on 4 core machine
time: 8.31 s vs time: 39 s for video non Parallel code vs time: 16.3 s for video Parallel code
would love to see it validated using the 10k data