Skip to content

feat(data): add 7 GPUs from Wikipedia list pages - #327

Merged
Seungpyo1007 merged 2 commits into
developfrom
Seungpyo1007/gpu-coverage-recheck
Sep 29, 2026
Merged

Seungpyo1007 merged 2 commits into
developfrom
Seungpyo1007/gpu-coverage-recheck

Conversation

@Seungpyo1007

Copy link
Copy Markdown
Member

What & why

A live reconciliation of the four Wikipedia GPU pages against current TechAPI records found 7 genuinely absent, complete models, all Nvidia. The 1,581 missing entries in TechEngine #19 are overwhelmingly non-actionable (1,574 / 99.6%): existing names with different punctuation, branding, memory/interface/mobile qualifiers; ATI records compared only against AMD; incomplete models; integrated graphics; and non-model cells caused by reading the first physical cell without expanding rowspans.

Source manufacturer Reported missing Real complete new models Added
AMD (including existing gpu/ati records) 813 0 0
Intel 343 0 0
Nvidia (list + Quadro) 425 7 7

Expand rowspan/colspan tables, select actual model columns (including Intel's separate branding/model columns), normalize both names and slugs ignoring punctuation, and inspect substring matches in both directions. A shared prefix alone is not a duplicate: MX 440 SE/8x, FX 5700 LE, plain FX 5900, and plain/XT 6800 have different specifications from the existing related cards.

Add GeForce4 MX 420, MX 440 SE, MX 440 8x, GeForce FX 5700 LE, FX 5900, GeForce 6800, and 6800 XT. These names cover 17 complete table configuration rows; add one explicitly sourced configuration per model, with no cross-row mixing. The historical single core clock is stored as both base and boost, following the dataset's pre-boost convention. Every addition is verified: false; no benchmark values are inferred.

Examples checked by hand: Radeon X1550 matches existing AGP/PCI entries; Radeon HD 2350 matches HD 2350 PRO; GeForce FX 5700 E.S. matches Engineering Sample; GTX 1060/1650 Ti and RTX 2050 mobile rows match existing mobile records; Quadro T500 Mobile matches T500 Mobile; RTX PRO 6000 Blackwell Max-Q Workstation Edition matches the shorter Max-Q name; Intel A770 16GB matches Arc A770's 16GB record. Arc Pro B70 is source-only but its single combined clock cell does not clearly establish both required base and boost clocks; no record is added by guessing. Older mobile cards often lack TDP, and integrated Intel graphics remain outside the discrete GPU scope.

The final commit regenerates GPU detail/score files, the GPU index, and the GPU manifest entry with the normal TechEngine seed/API dump code and a fresh isolated database. GPU count becomes 2,083; scored count stays 1,867. It also refreshes three stale existing Radeon Pro V-series dump verification flags from the current seed records.

Closes #295

Source

Fetched live on 2026-09-29:

Validation

  • python -m app.validate: passed.
  • All 7 JSON records equal their selected complete source-row candidates; unique GPU slugs checked across the category.
  • API detail fields match each new seed; new score pages have overall: null.
  • GPU manifest, index count, index results, and seed population all agree at 2,083.
  • git diff --check: passed.

No further complete, distinct models identified in this audit remain to add; incomplete/source-only rows need better sources rather than speculative fields.

@TechEngineBot

Copy link
Copy Markdown
Member

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

12/12 categories ? 191,826 records ? diff base develop@3c5fed8

Changed records in this PR

7 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 7
    "Yellow" : 0
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 7 7 0 0 100.0%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 7 7 0 0 100.0%

Full-dataset baseline

191826 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 32779
    "Yellow" : 157992
    "Red" : 1055
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 207 122 85 0 58.9%
soc 🟩🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥 2117 284 837 996 13.4%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93407 18003 75350 54 19.3%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3459 292 3166 1 8.4%
watch 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟥 447 94 350 3 21.0%
pda 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 140 83 57 0 59.3%
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨 2083 1536 547 0 73.7%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟥 4512 4219 292 1 93.5%
laptop 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 1995 107 1888 0 5.4%
monitor 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 882 0 882 0 0.0%
software 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 42493 366 42127 0 0.9%
website 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 40084 7673 32411 0 19.1%
All 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 191826 32779 157992 1055 17.1%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit 85ff747 into develop Sep 29, 2026
5 checks passed
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

12/12 categories ? 191,826 records ? diff base develop@3c5fed8

Check Result
python -m app.validate PASS
Changed dump JSON and manifest/index counts PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 7 0 0 0 7 0
cpu 0 0 0 0 0 0
laptop 0 0 0 0 0 0
monitor 0 0 0 0 0 0
software 0 0 0 0 0 0
website 0 0 0 0 0 0

Changed record examples

gpu added

  • gpu/nvidia/2002/consumer/geforce4-mx-420.json - NVIDIA GeForce4 MX 420
  • gpu/nvidia/2002/consumer/geforce4-mx-440-8x.json - NVIDIA GeForce4 MX 440 8x
  • gpu/nvidia/2002/consumer/geforce4-mx-440-se.json - NVIDIA GeForce4 MX 440 SE
  • gpu/nvidia/2003/consumer/geforce-fx-5900.json - NVIDIA GeForce FX 5900
  • gpu/nvidia/2004/consumer/geforce-6800.json - NVIDIA GeForce 6800
  • gpu/nvidia/2004/consumer/geforce-fx-5700-le.json - NVIDIA GeForce FX 5700 LE
  • gpu/nvidia/2005/consumer/geforce-6800-xt.json - NVIDIA GeForce 6800 XT

Heuristic review

  • Added records by manufacturer/brand: nvidia: 7
  • Added records by source class: other: 7
  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

12/12 categories ? 191,826 records ? diff base develop@3c5fed8

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 123 84 0 207 59.4%
soc 2117 284 1833 0 2117 13.4%
smartphone 93407 17581 75826 0 93407 18.8%
tablet 3459 288 3171 0 3459 8.3%
watch 447 94 353 0 447 21.0%
pda 140 74 66 0 140 52.9%
gpu 2083 1496 587 0 2083 71.8%
cpu 4512 4219 293 0 4512 93.5%
laptop 1995 105 1890 0 1995 5.3%
monitor 882 0 882 0 882 0.0%
software 42493 358 42135 0 42493 0.8%
website 40084 7635 32449 0 40084 19.0%
all 191826 32257 159569 0 191826 16.8%

Warning

Tracked verified coverage is below 50% for monitor 0.0% (0/882), software 0.8% (358/42493), laptop 5.3% (105/1995), tablet 8.3% (288/3459), soc 13.4% (284/2117), all 16.8% (32257/191826), smartphone 18.8% (17581/93407), website 19.0% (7635/40084), and 1 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base)
loaded CPU=4512 GPU=2083
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 132
GPU cross-source ratio outliers + sanity 51

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Data collection: new records (workstream)

2 participants