lance icon indicating copy to clipboard operation
lance copied to clipboard

perf: benchmarking encodings (read time, write time)

Open raunaks13 opened this issue 1 year ago • 0 comments

Many things to add/change, but wanted to get a review on the initial structure. Some considerations -

  1. Can add write benchmarking within the same functions, and populate results in the same csv file. In the future if we want to benchmark query performance we can add new functions to the same file.
  2. Later we can extend this to compare with frameworks other than pyarrow. But for now I have just compared pyarrow and lance.
  3. Can extend to other datasets and encodings

raunaks13 avatar May 23 '24 03:05 raunaks13