Add h3 boundries handling - #49
Merged
Merged
Conversation
- Integrated `StandaloneBoundaryImporter` service to enable standalone administrative boundary imports. - Added H3 (Uber H3) dependency for high-resolution geospatial indexing. - Updated import logic to process boundaries from PBF files and store outputs in RocksDB databases. - Enhanced geometry processing with support for buffering, simplification, and H3 polygon-to-cell mapping.
…planet-scale imports
…lation processing
- Added `SimplificationConfiguration` to `PaikkaConfiguration` to support configurable tolerances for geometry simplification. - Replaced hardcoded tolerance values in `GeometrySimplificationService` with values from configuration. - Updated tests to inject `PaikkaConfiguration` into `GeometrySimplificationService`. - Adjusted test properties and application configuration files to define default tolerance values.
… logging - Introduced SLF4J logger to `StandaloneBoundaryImporter` for comprehensive logging. - Added detailed geometry validation with repair logic for invalid geometries. - Replaced `polygonToCellsH3` with optimized `processCellsH3Stream` for better scalability. - Improved handling of simplified geometries and batch processing for H3 cells. - Made simplification tolerances configurable in `application-dev.properties`.
…te progress tracking
… update default logging level to ERROR in development config
- Added unit tests for boundary lookup with additional locations (e.g., Pölzig). - Adjusted RocksDB options to remove read-only constraint for enhanced flexibility. - Updated assertions to verify total cell counts and boundary hierarchy integrity.
…try simplification
…nd upload - Introduced `scripts/update-h3.sh` to automate H3 bundle generation. - Supports configurable options for memory, threads, and input paths. - Includes filtering, data import, bundling, and optional upload to R2 storage. - Enhanced error handling and directory preparation for seamless execution.
- Added `prepare-boundaries` command with symlink and execution setup in Dockerfile. - Updated `update-h3.sh` to rename filtered PBF output and disable Docker image pull. - Fixed `filter_boundaries.sh` to correct typo in description. - Simplified `import-boundaries.sh` by removing unnecessary cleanup steps.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.