simplipy icon indicating copy to clipboard operation
simplipy copied to clipboard
verified publisher icon albertferras

Reduce memory usage

Open albertferras opened this issue 10 years ago • 0 comments

As this blog post says http://jacobfilipp.com/creating-choropleth-maps-with-google-maps/ , simplipy isn't usable for the "Canada" geo data.

Simplifier uses >5.0gb of memory to simplify that dataset with DouglasPeucker(tolerance=5000) + Constraint Preserve Topology + Constraint Repair Intersections.

"Bottlenecks":

  • Repair intersections (finding segments with intersections) Simplifying geometries takes up 28% of my RAM. When it starts "repairing" intersections it goes to 90% (no more because kernel starts swapping and then I have to kill the process). See and try http://geomalgorithms.com/a09-_intersect-3.html to find segment intersections in another way.
  • Chain DB. Uses a lot of memory. Try to save some data on disk (!?)

albertferras avatar Dec 09 '15 19:12 albertferras