Skip to content

release: 8,839 verified promotions, software/website scoring and Wikidata fill (2026-09-27 ③) - #315

Merged
Seungpyo1007 merged 16 commits into
mainfrom
develop
Sep 27, 2026
Merged

Seungpyo1007 merged 16 commits into
mainfrom
develop

Conversation

@Seungpyo1007

Copy link
Copy Markdown
Member

Release ③ of 2026-09-27. Closes #1 (link only).

Verified: 22.2% of device categories, 16.8% of all 12 categories (up from 21.4% / 12.2%).

TechEngineBot and others added 16 commits September 27, 2026 05:32
Auto-promotions from the verification layer (green+live-source or crossref-confirm).
Each flip is verified:false->true only; see data/_verify/ledger.jsonl. Refs #1
Auto-promotions from the verification layer (green+live-source or crossref-confirm).
Each flip is verified:false->true only; see data/_verify/ledger.jsonl. Refs #1
…ource

These records were green but never had their own citation checked (check-urls
frontier and dedupe bugs, fixed in GetTechAPI/TechEngine#104 and #105). Each now
has a live Tier-1/Tier-2 citation; cpubenchmark.net returns 404 for unknown or
near-miss CPU names, so a live page confirms the exact SKU.

Refs #296
… Wikidata items

Adds values only where the field was absent, taken from the Wikidata item each
record already cites: programming languages (9,157), operating systems (741),
developers (102), licenses (37), release dates (13) and publishers/genres for
9,655 software records; homepage, launch date (1991 or later only), languages
and owners for 103 websites. No existing value changes.

Refs #295
Auto-promotions from the verification layer (green+live-source or crossref-confirm).
Each flip is verified:false->true only; see data/_verify/ledger.jsonl. Refs #1
…idata-filled software fields

Publishes the software/website, CPU, GPU and SoC promotions from #309-#313 and
the fields filled from each software and website record's Wikidata item (#312).

Refs #1
@github-actions github-actions Bot added data Dataset changes enhancement New feature or request labels Sep 27, 2026
@Seungpyo1007
Seungpyo1007 merged commit d3aac35 into main Sep 27, 2026
5 checks passed
@TechEngineBot

Copy link
Copy Markdown
Member

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

12/12 categories ? 191,814 records ? diff base main@3957576

Changed records in this PR

18391 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 8847
    "Yellow" : 9544
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
soc 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 31 31 0 0 100.0%
smartphone 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 25 25 0 0 100.0%
watch 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 3 3 0 0 100.0%
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 21 21 0 0 100.0%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 764 764 0 0 100.0%
laptop 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 2 2 0 0 100.0%
software 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 9865 366 9499 0 3.7%
website 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨 7680 7635 45 0 99.4%
All 🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨🟨 18391 8847 9544 0 48.1%

Full-dataset baseline

191814 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 32764
    "Yellow" : 157995
    "Red" : 1055
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 207 122 85 0 58.9%
soc 🟩🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥 2117 284 837 996 13.4%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93407 18003 75350 54 19.3%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3459 292 3166 1 8.4%
watch 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟥 447 94 350 3 21.0%
pda 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 140 83 57 0 59.3%
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨 2076 1529 547 0 73.7%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟥 4507 4211 295 1 93.4%
laptop 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 1995 107 1888 0 5.4%
monitor 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 882 0 882 0 0.0%
software 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 42493 366 42127 0 0.9%
website 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 40084 7673 32411 0 19.1%
All 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 191814 32764 157995 1055 17.1%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

12/12 categories ? 191,814 records ? diff base main@3957576

Check Result
python -m app.validate PASS
Changed dump JSON and manifest/index counts PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 31 0 0 0 0
smartphone 0 25 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 3 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 21 0 0 0 0
cpu 0 764 0 0 0 0
laptop 0 2 0 0 0 0
monitor 0 0 0 0 0 0
software 0 9865 0 0 0 0
website 0 7680 0 0 0 0

Changed record examples

soc modified

  • soc/apple/2022/apple-a16-bionic-apl1w10-t8120.json - Apple A16 Bionic APL1W10 T8120
  • soc/apple/2026/apple-a20-pro.json - Apple A20 Pro
  • soc/hisilicon/2014/hisilicon-kirin-910t.json - HiSilicon Kirin 910T
  • soc/hisilicon/2014/hisilicon-kirin928.json - HiSilicon KIRIN928
  • soc/huawei/2019/kirin-810.json - Kirin 810
  • soc/huawei/2019/kirin-990-4g.json - Kirin 990 (4G)
  • soc/huawei/2020/kirin-9000e.json - Kirin 9000E
  • soc/mediatek/2020/dimensity-720.json - Dimensity 720
  • soc/mediatek/2020/dimensity-800u.json - Dimensity 800U
  • soc/mediatek/2020/dimensity-820.json - Dimensity 820
  • soc/mediatek/2020/mediatek-dimensity-800-mt6873-mt6873v.json - MediaTek Dimensity 800 MT6873 / MT6873V
  • soc/mediatek/2021/dimensity-810.json - Dimensity 810
  • soc/mediatek/2021/dimensity-900.json - Dimensity 900
  • soc/mediatek/2021/dimensity-920.json - Dimensity 920
  • soc/mediatek/2022/mediatek-dimensity-8000-mt6895.json - MediaTek Dimensity 8000 MT6895
  • ... 16 more

smartphone modified

  • smartphone/acer/2016/liquid-z6/acer-liquid-z6-beridzeg45-3851-1gb.json - Acer Liquid Z6
  • smartphone/alcatel/2016/shine-lite/alcatel-shine-lite-beridzeg45-7037-2gb.json - alcatel Shine Lite
  • smartphone/allview/2017/x4-soul-mini-s/allview-x4-soul-mini-s-beridzeg45-4842-1gb.json - Allview X4 Soul Mini S
  • smartphone/archos/2017/50-graphite/archos-50-graphite-beridzeg45-6371-1gb.json - Archos 50 Graphite
  • smartphone/archos/2017/55-graphite/archos-55-graphite-beridzeg45-3378-2gb.json - Archos 55 Graphite
  • smartphone/asus/2016/zenfone-pegasus-3/asus-zenfone-pegasus-3-beridzeg45-177-2gb.json - Asus Zenfone Pegasus 3
  • smartphone/blackview/2017/a7-pro/blackview-a7-pro-beridzeg45-2756-2gb.json - Blackview A7 Pro
  • smartphone/energizer/2017/energy-e520-lte/energizer-energy-e520-lte-beridzeg45-4438-2gb.json - Energizer Energy E520 LTE
  • smartphone/energizer/2017/energy-s550/energizer-energy-s550-beridzeg45-4990-1gb.json - Energizer Energy S550
  • smartphone/energizer/2017/power-max-p550s/energizer-power-max-p550s-beridzeg45-3178-2gb.json - Energizer Power Max P550S
  • smartphone/gionee/2016/steel-2/gionee-steel-2-beridzeg45-2695-3gb.json - Gionee Steel 2
  • smartphone/htc/2010/7-mozart.json - 7 Mozart
  • smartphone/meizu/2017/m5c/meizu-m5c-beridzeg45-4378-2gb.json - Meizu M5c
  • smartphone/micromax/2017/canvas-evok-power-q4260/micromax-canvas-evok-power-q4260-beridzeg45-6706-2gb.json - Micromax Canvas Evok Power Q4260
  • smartphone/motorola/2017/moto-c-plus/motorola-moto-c-plus-beridzeg45-922-1gb.json - Motorola Moto C Plus
  • ... 10 more

watch modified

  • watch/samsung/2014/gear-2-neo/samsung-gear-2-neo-beridzeg45-2254-0-5gb.json - Samsung Gear 2 Neo
  • watch/samsung/2014/gear-2/samsung-gear-2-0-5gb-4gb-2g.json - Samsung Gear 2
  • watch/samsung/2014/gear-2/samsung-gear-2-beridzeg45-958-0-5gb.json - Samsung Gear 2

gpu modified

  • gpu/amd/2015/enterprise/firepro-s9170.json - FirePro S9170
  • gpu/amd/2016/consumer/radeon-e9260-pcie.json - Radeon E9260 PCIe
  • gpu/amd/2016/consumer/radeon-rx-470d.json - Radeon RX 470D
  • gpu/amd/2016/enterprise/firepro-s7100x.json - FirePro S7100X
  • gpu/amd/2016/enterprise/radeon-instinct-mi8.json - Radeon Instinct MI8
  • gpu/amd/2017/consumer/radeon-e9173-pcie.json - Radeon E9173 PCIe
  • gpu/amd/2017/consumer/radeon-e9175-pcie.json - Radeon E9175 PCIe
  • gpu/amd/2017/consumer/radeon-rx-550-640sp.json - Radeon RX 550 640SP
  • gpu/amd/2017/consumer/radeon-rx-560d.json - Radeon RX 560D
  • gpu/amd/2017/enterprise/radeon-instinct-mi25.json - Radeon Instinct MI25
  • gpu/amd/2018/consumer/radeon-rx-550x-640sp.json - Radeon RX 550X 640SP
  • gpu/amd/2018/enterprise/radeon-instinct-mi50.json - Radeon Instinct MI50
  • gpu/amd/2019/consumer/radeon-e9390-pcie.json - Radeon E9390 PCIe
  • gpu/amd/2019/consumer/radeon-e9560-pcie.json - Radeon E9560 PCIe
  • gpu/nvidia/2004/consumer/geforce-6600-gt-agp.json - GeForce 6600 GT AGP
  • ... 6 more

cpu modified

  • cpu/amd/2009/enterprise/amd-opteron-2218.json - AMD Opteron 2218
  • cpu/amd/2009/enterprise/amd-opteron-2220-se.json - AMD Opteron 2220 SE
  • cpu/amd/2009/enterprise/amd-opteron-2220.json - AMD Opteron 2220
  • cpu/amd/2009/enterprise/amd-opteron-2356.json - AMD Opteron 2356
  • cpu/amd/2009/enterprise/amd-opteron-2378.json - AMD Opteron 2378
  • cpu/amd/2009/enterprise/amd-opteron-2384.json - AMD Opteron 2384
  • cpu/amd/2009/enterprise/amd-opteron-2431.json - AMD Opteron 2431
  • cpu/amd/2009/enterprise/amd-opteron-280.json - AMD Opteron 280
  • cpu/amd/2009/enterprise/amd-opteron-285.json - AMD Opteron 285
  • cpu/amd/2009/enterprise/amd-opteron-290.json - AMD Opteron 290
  • cpu/amd/2010/consumer/amd-athlon-5200-dual-core.json - AMD Athlon 5200 Dual-Core
  • cpu/amd/2010/consumer/amd-athlon-64-x2-dual-core-3400-plus.json - AMD Athlon 64 X2 Dual Core 3400+
  • cpu/amd/2010/consumer/amd-athlon-dual-core-4850b.json - AMD Athlon Dual Core 4850B
  • cpu/amd/2010/consumer/amd-athlon-ii-170u.json - AMD Athlon II 170u
  • cpu/amd/2010/consumer/amd-athlon-ii-x2-210e.json - AMD Athlon II X2 210e
  • ... 749 more

laptop modified

  • laptop/microsoft/2019/microsoft-surface-laptop-3.json - Microsoft Surface Laptop 3
  • laptop/microsoft/2021/microsoft-surface-laptop-4.json - Microsoft Surface Laptop 4

software modified

  • software/0-/0-a-d.json - 0 A.D.
  • software/0n/0no-co-graphql-web.json - @0no-co/graphql.web
  • software/11/113983-wild-demo.json - 113983 (wild demo)
  • software/19/1964.json - 1964
  • software/1c/1c-enterprise.json - 1C:Enterprise
  • software/2-/2-thenable.json - 2-thenable
  • software/20/20-sim.json - 20-sim
  • software/36/360-safeguard.json - 360 Safeguard
  • software/36/360softmanager.json - 360softmanager
  • software/38/389-directory-server.json - 389 Directory Server
  • software/3c/3cx-phone-system.json - 3CX Phone System
  • software/3d/3d-ai-studio.json - 3D AI Studio
  • software/3d/3d-construction-kit.json - 3D Construction Kit
  • software/3d/3dldf.json - 3DLDF
  • software/3p/3proxy.json - 3proxy
  • ... 9850 more

website modified

  • website/02/02ws.json - 02WS
  • website/08/08euro-ru.json - 08euro.Ru
  • website/10/100-bombardirov.json - 100 bombardirov
  • website/10/100-years-100-objects.json - 100 Years 100 Objects
  • website/10/1000-awesome-things.json - 1000 Awesome Things
  • website/10/1000-logos.json - 1000 Logos
  • website/10/1000-q164888.json - 1000°
  • website/10/101-great-goals.json - 101 Great Goals
  • website/11/11street.json - 11Street
  • website/12/121trd.json - 121TRD
  • website/14/148apps.json - 148Apps
  • website/14/14ymedio.json - 14ymedio
  • website/15/15-ai.json - 15.ai
  • website/15/1500tasvir.json - 1500Tasvir
  • website/15/15min.json - 15min
  • ... 7665 more

Heuristic review

  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

12/12 categories ? 191,814 records ? diff base main@3957576

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 123 84 0 207 59.4%
soc 2117 280 1837 0 2117 13.2%
smartphone 93407 17581 75826 0 93407 18.8%
tablet 3459 288 3171 0 3459 8.3%
watch 447 94 353 0 447 21.0%
pda 140 74 66 0 140 52.9%
gpu 2076 1493 583 0 2076 71.9%
cpu 4507 4211 296 0 4507 93.4%
laptop 1995 105 1890 0 1995 5.3%
monitor 882 0 882 0 882 0.0%
software 42493 358 42135 0 42493 0.8%
website 40084 7635 32449 0 40084 19.0%
all 191814 32242 159572 0 191814 16.8%

Warning

Tracked verified coverage is below 50% for monitor 0.0% (0/882), software 0.8% (358/42493), laptop 5.3% (105/1995), tablet 8.3% (288/3459), soc 13.2% (280/2117), all 16.8% (32242/191814), smartphone 18.8% (17581/93407), website 19.0% (7635/40084), and 1 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base)
loaded CPU=4507 GPU=2076
Integrity section Flagged lines
structural 18
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 131
GPU cross-source ratio outliers + sanity 51

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants