fogpy icon indicating copy to clipboard operation
fogpy copied to clipboard

Speed up fogpy

Open gerritholl opened this issue 6 years ago • 3 comments

Fogpy is rather slow. Needs some profiling, and probably some of the lower-end functions could be rewritten in numba to speed things up considerably.

gerritholl avatar May 03 '19 13:05 gerritholl

https://medium.com/capital-one-tech/dask-numba-for-efficient-in-memory-model-scoring-dfc9b68ba6ce

gerritholl avatar May 03 '19 13:05 gerritholl

I expect that instead of looping through all pixels such as done here, it should be possible to loop through all objects (see also scipy.ndimage.find_objects).

https://github.com/gerritholl/fogpy/blob/2c9aa9436e4924f55879d52a9de14817d370df5a/fogpy/algorithms.py#L644-L671

gerritholl avatar May 03 '19 15:05 gerritholl

Need to check if a small region is faster than a large region. It should be. If it isn't, something with the order of resampling is not correct.

gerritholl avatar Mar 26 '20 10:03 gerritholl