sybil icon indicating copy to clipboard operation
sybil copied to clipboard

[query path] early filtering

Open okayzed opened this issue 7 years ago • 1 comments

this task is to add early filtering to the loading samples off disk. this allows us to skip over records that are not applicable instead of waiting until the query stage.

according to abadi, late materialization can speed up queries enormously, but its not clear to me how to late filter when each thread is loading a separate column off disk

okayzed avatar Nov 23 '18 19:11 okayzed

my first attempt was 1) slower than filtering after loading and 2) giving wrong answers. :cry:

okayzed avatar Dec 02 '18 20:12 okayzed