Rearrange encoding to increase numbers of bits available as index

Open simonpoole opened this issue 3 years ago • 1 comments

Fixes https://github.com/simonpoole/mapsplit/issues/30

Mar 14 '22 16:03 simonpoole

With the changes in this PR I was able to split an extract for Europe (30GB) on a 172GB machine. The 1st pass processing took less than two hours (and that is without a number of performance fixes that have been made here), however serializing and writing the tiles out is very slow as we can't hold enough buffers for the tiles in memory on such a machine and need to revert to multiple passes.

Mar 19 '22 12:03 simonpoole