Repository navigation
Data collection: new records (workstream) #295
Description
Purpose
Tracker for new records: products the dataset does not have yet. It is one of the workstreams split out of the #1 roadmap on 2026-09-27.
PRs that add records (feat(data…), label data without bug) link here with Closes #<this>. The tracker stays open; auto-close is disabled for tracking issues.
Scope
- New CPUs, GPUs, SoCs, smartphones, tablets, watches, PDAs, laptops, monitors
- Benchmark backfill for existing records (filling empty score fields)
- New source integrations (Wikipedia list pages, manufacturer spec pages, CC datasets)
Not in scope: correcting existing values (see the accuracy tracker) and engine/bot changes (see the automation tracker).
Rules
- Every record cites
source_urls. Nothing is invented; if no source states a value, it stays null or the record is skipped. - Bulk imports land as
verified: false. The verify layer promotes them later. - Source policy (SPEC.md): Wikipedia, Wikidata, manufacturer pages and CC datasets are fine. GSMArena and PhoneDB may only be used to correct existing values (ADR-013). Namuwiki is banned. DeviceSpecifications is paused.
- Dedup against existing slugs in both directions and ignoring punctuation (e.g.
geforce3-ti500=geforce3-ti-500).
Lanes and status (2026-09-27)
| Lane | Status | Notes |
|---|---|---|
| Wikipedia GPU list pages | 7 Nvidia additions pending (#327); otherwise exhausted for complete rows | Rechecked 2026-09-29: AMD 0, Intel 0, Nvidia 7 genuinely new complete models vs 813/343/425 reported gaps; remaining entries are existing aliases, incomplete, out of scope, or non-model cells |
| Wikipedia CPU lists (AMD EPYC/Ryzen, Intel sub-pages) | Mostly done | About 390 older Xeon/Celeron rows lack a thread count; 83 were filled from Intel spec pages |
| Wikipedia phone/tablet/watch categories + manufacturer phone lists | Nearly exhausted for complete rows; 1 Apple addition pending (#328) | Manufacturer lists rechecked 2026-09-29: Apple 1, Google 0, Samsung 0 complete new models vs 231/8/109 reported gaps; four absent Pixel 11 models need a Tensor G6 SoC FK (and missing source fields), Samsung timeline lacks required specs; earlier category gaps include Xring O3/Exynos 1610 and Wh-only batteries |
| Apple M-series, MacBooks, Surface laptops | Done | M1-M6, 31 MacBooks, 13 Surface |
| Benchmarks (topcpu, SPEC CPU2006, Blender, PassMark, Time Spy) | Done for current records | Re-run after large imports; DX12 guard needed |
Reporting
One comment per batch: how many records were added, the sources, and the remaining gaps. The Development links list the individual PRs; per-PR status lives on Project #2.
Metadata
Metadata
Assignees
Type
Projects
- Status
Activity
ci: route PRs to workstream trackers and stop per-PR tracker comments
feat(data): add Pixel Watch 4 41 mm and 45 mm (2025)
feat(data): add Snapdragon wearable SoCs and Galaxy Watch9 / Watch Ul…
feat(data): add Pixel Watch 4 41 mm and 45 mm (2025)
fix(ingest): annotate compact entity cache payload
fix(ingest): annotate compact entity cache payload
fix(ingest): retry truncated Wikidata entity batches
11 remaining items
data(device_catalog): add 231 Play-listed devices for brands z
data(brand): add 1881 device makers seen in Google Play's device list
data(device_catalog): add 2885 Play-listed devices for brands 1-d
data(device_catalog): add 2802 Play-listed devices for brands e-k
data(device_catalog): add 2897 Play-listed devices for brands l-q
data(device_catalog): add 2968 Play-listed devices for brands r-y
data(device_catalog): add 231 Play-listed devices for brands z
Seungpyo1007 commentedon Oct 6, 2026
Google Play expansion merged (#360): 11,783
device_catalogentries (6,517 phones / 5,223 tablets / 43 watches) and 1,881 new device makers underbrand/unknown/. Specs come from the Play Console catalog (RAM/SoC/GPU/screen/SDK); there are no release dates by design (ADR-016). Major-brand new devices are held for review.data(brand): add 934 device makers seen in Google Play's device list
data(device_catalog): add 2840 Play-listed devices for brands 1-g
data(device_catalog): add 2878 Play-listed devices for brands h-o
data(device_catalog): add 2568 Play-listed devices for brands p-z
Seungpyo1007 commentedon Oct 6, 2026
Google Play hold-queue round merged (#362): 8,286
device_catalogentries + 934 makers, allverified: false, gated by TechEngineapp.verify candidates(#123). These entries are below the 95% bar (blind audits 72–86%) and were included deliberately because Play is an authoritative device listing; major-brand rows without a Console entry (43%) are excluded.data(device_catalog): add 297 Play-listed devices for brands a-z
Seungpyo1007 commentedon Oct 6, 2026
Major-brand rows without a Play Console entry merged as well (#363): 297
device_catalogentries,verified: false. Of the 321 gate accepts, 24 TV/box/player/camera or carrier-branded rows were removed. The blind audit put this pool at 43%, so expect carrier/regional variants of existing devices in it.