Skip to content

Add 24 catalog datasets spanning crime, companies, occupations, and global weather. - #1

Merged
mattfaltyn merged 2 commits into
mainfrom
add-24-catalog-datasets
Aug 18, 2026
Merged

Add 24 catalog datasets spanning crime, companies, occupations, and global weather.#1
mattfaltyn merged 2 commits into
mainfrom
add-24-catalog-datasets

Conversation

@mattfaltyn

Copy link
Copy Markdown
Member

Summary

  • Expand the catalog from 76 to 100 datasets. Terms-gate kept all 24 planned IDs (no fallbacks): WHO GHO remains CC BY 4.0 with no commercial-sale ban; O*NET uses database downloads rather than Web Services; MET Norway is CC BY + NLOD; OurAirports is public domain; FDIC BankFind is still unkeyed; FBI CDE is keyed via api.data.gov.
  • Theme map: Environment (met-norway-locationforecast, noaa-storm-events); Government (legislation-gov-uk, uk-police-street-crime, fbi-crime-data-explorer, nih-reporter-projects); Markets (gleif-lei, companies-house-uk, fdic-bank-find, cftc-commitment-of-traders, census-county-business-patterns, ecb-statistical-data-warehouse); Health (open-food-facts, cms-nursing-homes, cdc-social-vulnerability-index, fda-orange-book); Demographics (onet-occupations, worldpop-population, who-gho-indicators); Research (wikidata-query); Technology (first-epss, openssf-scorecard); Geospatial (osm-overpass, ourairports).
  • Added unauthenticated GET provider contracts for 15 sources (first-epss, openssf-scorecard, legislation-gov-uk, uk-police-street-crime, gleif-lei, fdic-bank-find, cftc-commitment-of-traders, ecb-statistical-data-warehouse, open-food-facts, cms-nursing-homes, who-gho-indicators, wikidata-query, met-norway-locationforecast, osm-overpass, ourairports). Skipped keyed/POST/huge-download sources: companies-house-uk, census-county-business-patterns, nih-reporter-projects, onet-occupations, worldpop-population, noaa-storm-events, cdc-social-vulnerability-index, fda-orange-book, fbi-crime-data-explorer.

Test plan

  • npm run validate-datasets:offline — 100 YAML OK, Python syntax OK
  • npm test and npm run lint
  • npm run validate-datasets — live URL markers for the 24 new sources
  • Live checkProviderContract for the 15 new contracts only (did not treat pre-existing ECHO/NHTSA failures as blockers)
  • npm run build then npm run test:e2e (100 guides, 13 catalog pages)

Made with Cursor

…lobal weather.

Co-authored-by: Cursor <cursoragent@cursor.com>
@vercel

vercel Bot commented Aug 18, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
foundation_data Ready Ready Preview Aug 18, 2026 9:04am

Request Review

Co-authored-by: Cursor <cursoragent@cursor.com>
@mattfaltyn
mattfaltyn merged commit d7bb52f into main Aug 18, 2026
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant