Skip to content

Add shapefile version and error count to upload metadata (C-15) #12

@Polichinel

Description

@Polichinel

Context

Both dsm.upload_data() calls in _save() carry metadata but lack enrichment provenance. An enrichment timestamp was added, but the following are still missing:

  • Shapefile version/hash (which GAUL/Natural Earth version produced the assignments)
  • Enrichment error count (how many GIDs had geometry errors or were unmapped)
  • Unmapped cell count

Without this, the FAO cannot audit the quality of received data or detect when a shapefile update changed assignments between deliveries.

Requirements

  • Add shapefile version identifier to upload metadata (at minimum, a hash or modification date of the loaded shapefiles)
  • Add enrichment error count if batch failures occurred
  • Determine whether upload_data() API supports additional metadata fields, or if description is the only free-text field

Risk Register

C-15 (Tier 3). Partially fixed (timestamp added). Remaining: no shapefile provenance.

Note

If ADR-011 is implemented (precomputed lookup table), the provenance becomes the lookup table's version/hash instead of shapefile metadata. The requirement for provenance remains regardless of enrichment method.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions