Skip to content

feat(data): add 64 Intel CPUs from List_of_Intel_microprocessors - #326

Merged
Seungpyo1007 merged 2 commits into
developfrom
feat/intel-microprocessors-reconcile
Sep 29, 2026
Merged

Seungpyo1007 merged 2 commits into
developfrom
feat/intel-microprocessors-reconcile

Conversation

@Seungpyo1007

Copy link
Copy Markdown
Member

The general Intel processor page contains genuine modern SKU gaps alongside already curated names, family summaries and incomplete specifications. This adds 64 complete, absent Intel CPU records sourced from https://en.wikipedia.org/wiki/List_of_Intel_microprocessors after reconciling the live tables against develop at cc19e9d2c2b9 (2,913 Intel records).

Reconciled entries Checked Already existed Added Out of scope Incomplete / family summary
Distinct SKU-table models 606 450 64 0 92
Named release-timeline entries 45 0 0 6 39
Total 651 450 64 6 131

All 62 tables were inspected: 58 SKU tables, one timeline and three product-code/family cross-reference tables. The SKU tables contain 609 rows and three repeated models. The six excluded timeline entries predate 1989; the 39 later timeline entries are family/generation summaries without per-SKU specifications. Historical prose and product-code summaries produced no additions. These are reconciled live-source counts, not the old coverage report's 1,259 exact-slug misses.

Deduplication checks normalized names, slugs and bare SKU identifiers in both directions with the existing CPU identity helpers, ignoring punctuation and keeping variant suffixes. For example, Pentium G7400 matches curated Pentium Gold G7400. The normal additions-only ingest pipeline performed the final check before writing.

Every addition cites the exact Wikipedia URL and remains verified: false. Architectures come from explicit codename columns or table captions, and unknown optional fields remain null. Threads are taken only from explicit thread columns or explicitly labelled core/thread pairs. Quarter dates follow the existing collector's quarter-start convention.

The 92 skipped SKU models include 63 with no stated threads, 19 without usable release dates, one without an explicit architecture, and nine otherwise complete rows with contradictory total/component counts. Reasons overlap: two rows lacking threads also have inconsistent core counts. The nine complete conflicts include Core i7-13650HX and eight Meteor Lake-PS HL/UL rows; their source inconsistencies were not guessed away.

Validation: the TechAPI bundled validator and TechEngine validator both pass against the CPU/brand checkout. The final commit refreshes the CPU static dump through the existing seed/API/dump machinery, checks the 4,628-record CPU index and manifest, and verifies all 64 new detail and score pages. Existing CPU percentile changes reflect the expanded comparison population. Other collection manifest entries and OpenAPI are preserved. No reusable TechEngine code was added.

Refs GetTechAPI/TechEngine#19.

Closes #295

@TechEngineBot

Copy link
Copy Markdown
Member

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

12/12 categories ? 191,752 records ? diff base develop@cc19e9d

Changed records in this PR

64 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 64
    "Yellow" : 0
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 64 64 0 0 100.0%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 64 64 0 0 100.0%

Full-dataset baseline

191752 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 32886
    "Yellow" : 157812
    "Red" : 1054
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 207 122 85 0 58.9%
soc 🟩🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥 2117 284 837 996 13.4%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93407 18003 75350 54 19.3%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3305 289 3015 1 8.7%
watch 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟥 418 93 323 2 22.2%
pda 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 140 83 57 0 59.3%
gpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨 2076 1529 547 0 73.7%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟥 4628 4337 290 1 93.7%
laptop 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 1995 107 1888 0 5.4%
monitor 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 882 0 882 0 0.0%
software 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 42493 366 42127 0 0.9%
website 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 40084 7673 32411 0 19.1%
All 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 191752 32886 157812 1054 17.2%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit 3c5fed8 into develop Sep 29, 2026
5 checks passed
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

12/12 categories ? 191,752 records ? diff base develop@cc19e9d

Check Result
python -m app.validate PASS
Changed dump JSON and manifest/index counts PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 64 0 0 0 64 0
laptop 0 0 0 0 0 0
monitor 0 0 0 0 0 0
software 0 0 0 0 0 0
website 0 0 0 0 0 0

Changed record examples

cpu added

  • cpu/intel/2019/consumer/core-i3-9100e.json - Intel Core i3 9100E
  • cpu/intel/2019/consumer/core-i5-8310y.json - Intel Core i5 8310Y
  • cpu/intel/2019/consumer/core-i5-9500e.json - Intel Core i5 9500E
  • cpu/intel/2019/consumer/core-i7-1060g7.json - Intel Core i7 1060G7
  • cpu/intel/2020/consumer/core-i3-1120g4.json - Intel Core i3 1120G4
  • cpu/intel/2022/consumer/core-i5-12450hx.json - Intel Core i5 12450HX
  • cpu/intel/2022/consumer/core-i7-12650hx.json - Intel Core i7 12650HX
  • cpu/intel/2023/consumer/core-i3-13100f.json - Intel Core i3 13100F
  • cpu/intel/2023/consumer/core-i3-13100t.json - Intel Core i3 13100T
  • cpu/intel/2023/consumer/core-i5-13400t.json - Intel Core i5 13400T
  • cpu/intel/2023/consumer/core-i5-1340p.json - Intel Core i5 1340P
  • cpu/intel/2023/consumer/core-i5-13420h.json - Intel Core i5 13420H
  • cpu/intel/2023/consumer/core-i5-13450hx.json - Intel Core i5 13450HX
  • cpu/intel/2023/consumer/core-i5-13490f.json - Intel Core i5 13490F
  • cpu/intel/2023/consumer/core-i5-13500h.json - Intel Core i5 13500H
  • ... 49 more

Heuristic review

  • Added records by manufacturer/brand: intel: 64
  • Added records by source class: other: 64
  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

12/12 categories ? 191,752 records ? diff base develop@cc19e9d

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 123 84 0 207 59.4%
soc 2117 284 1833 0 2117 13.4%
smartphone 93407 17581 75826 0 93407 18.8%
tablet 3305 285 3020 0 3305 8.6%
watch 418 93 325 0 418 22.2%
pda 140 74 66 0 140 52.9%
gpu 2076 1496 580 0 2076 72.1%
cpu 4628 4219 409 0 4628 91.2%
laptop 1995 105 1890 0 1995 5.3%
monitor 882 0 882 0 882 0.0%
software 42493 358 42135 0 42493 0.8%
website 40084 7635 32449 0 40084 19.0%
all 191752 32253 159499 0 191752 16.8%

Warning

Tracked verified coverage is below 50% for monitor 0.0% (0/882), software 0.8% (358/42493), laptop 5.3% (105/1995), tablet 8.6% (285/3305), soc 13.4% (284/2117), all 16.8% (32253/191752), smartphone 18.8% (17581/93407), website 19.0% (7635/40084), and 1 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base)
loaded CPU=4628 GPU=2076
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 132
GPU cross-source ratio outliers + sanity 51

@Seungpyo1007
Seungpyo1007 deleted the feat/intel-microprocessors-reconcile branch September 30, 2026 08:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Data collection: new records (workstream)

2 participants