Simple-kNN-Gzip icon indicating copy to clipboard operation
Simple-kNN-Gzip copied to clipboard

Fast Simple Parallel Gzip NCD Calculation

Open BAW2501 opened this issue 2 years ago • 0 comments

Refactored code to improve performance and readability

  • Using the joblib.Parallel library to parallelize the computation of the NCD matrix.
  • Simpler logic for NCD calculation
  • Removing unnecessary comments and improving the formatting of the code.
  • tested code speed on 4 core machine

time: 8.31 s vs time: 39 s for video non Parallel code vs time: 16.3 s for video Parallel code

would love to see it validated using the 10k data

BAW2501 avatar Jul 29 '23 15:07 BAW2501