geomesa icon indicating copy to clipboard operation
geomesa copied to clipboard

GEOMESA-3259 FSDS - Add support for GeoParquet

Open adeet1 opened this issue 1 year ago • 1 comments

  • Create a bounding box for each geometry, and add it to the GeoParquet metadata (which requires the metadata map to be changed to a mutable data structure)
  • Read and write all geometry attributes as binary (a primitive Parquet type) instead of as a pair of x/y doubles (a group Parquet type), using the same converter and attribute writer for all geometry types, while also maintaining backwards compatibility
  • Add support for parsing WKB bytes in the Parquet geometry transformer functions
  • Use a spatial index instead of a GeoTools filter for bounding box queries

adeet1 avatar Mar 20 '24 14:03 adeet1

To-do items:

  • [x] Make FilterConverter.spatial backwards-compatible
  • [ ] Add support for 3D geometries and bounding boxes
  • [x] Add a unit test assert that ensures the file metadata validates against the GeoParquet metadata schema

adeet1 avatar Mar 20 '24 15:03 adeet1