Skip to content

Fix import issue in differ#2074

Merged
vish-cs merged 1 commit into
datacommonsorg:masterfrom
vish-cs:revert-file-util-import-and-fix-differ
Jun 17, 2026
Merged

Fix import issue in differ#2074
vish-cs merged 1 commit into
datacommonsorg:masterfrom
vish-cs:revert-file-util-import-and-fix-differ

Conversation

@vish-cs

@vish-cs vish-cs commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Revert import changes to file_util.py and handle in differ_utils.py instead.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the dataset differ utility to output MCF diff files and a consolidated JSON summary instead of CSV files, and updates the import validation runner to parse these new formats. It also introduces a new direct runner mode using a Java bundle. The code review feedback highlights a few areas of improvement: resolving a potential data loss bug in write_mcf_nodes where dcid properties could be omitted, replacing fragile string checks for 'nan' with robust pd.isna() calls, and making the MCF parser in the validation runner more resilient to arbitrary spacing around colons.

Comment thread tools/import_differ/differ_utils.py
Comment thread tools/import_differ/import_differ.py
Comment thread tools/import_validation/runner.py
@vish-cs vish-cs force-pushed the revert-file-util-import-and-fix-differ branch from 8e532c0 to b293f41 Compare June 17, 2026 11:25
@vish-cs vish-cs requested a review from kartik-s21 June 17, 2026 11:29
@vish-cs vish-cs enabled auto-merge (squash) June 17, 2026 11:31
@vish-cs vish-cs force-pushed the revert-file-util-import-and-fix-differ branch from b293f41 to 0c812fa Compare June 17, 2026 11:38
@vish-cs vish-cs merged commit d2a81cf into datacommonsorg:master Jun 17, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants