Skip to content

data: add 8.3k unverified Google Play device_catalog entries (hold-queue round) - #362

Merged
Seungpyo1007 merged 4 commits into
developfrom
data/play-device-catalog-2
Oct 6, 2026
Merged

Seungpyo1007 merged 4 commits into
developfrom
data/play-device-catalog-2

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Oct 6, 2026 •

Copy link
Copy Markdown
Member

Summary

This is the second round of Google Play device_catalog entries: 8,286 identity entries (all verified: false) and 934 device makers under brand/unknown/.

These are rows from the Play hold queue that passed the new TechEngine gate (python -m app.verify candidates, TechEngine #123), followed by the cheap filters from the last audit:

  • names normalised;
  • carrier-branded rows held;
  • Walkman, camera, player, box and POS rows dropped.

Major-brand rows without a Play Console entry are excluded. They audited at 43%.

pool entries blind audit (fresh 100-row sample, before the last filters)
white-label, no Console row 7,647 72% strict / 80% excluding unsure
major brand, Console row 613 86%
white-label, Console row 26 —

Accuracy note

These entries sit below the 95% bar used for #359–#361. They are merged as unverified on purpose: Google Play is an authoritative listing of devices that shipped with Play.

Expected errors:

  • labels that are really codenames (Jax N, M40 plus);
  • some old carrier variants of devices already in the dataset;
  • an occasional non-phone.

They stay verified: false and can be corrected or removed through the normal review flow.

Policy: ADR-016. Closes #295

Country is not sourced for these makers, so they live under brand/unknown/ (ADR-016).

Refs #295
Identity from Google Play supported_devices.csv; RAM/SoC/GPU/screen/SDK from the Play Console device catalog where it lists the device.
No release dates (unknown by design, ADR-016).

Refs #295
Identity from Google Play supported_devices.csv; RAM/SoC/GPU/screen/SDK from the Play Console device catalog where it lists the device.
No release dates (unknown by design, ADR-016).

Refs #295
Identity from Google Play supported_devices.csv; RAM/SoC/GPU/screen/SDK from the Play Console device catalog where it lists the device.
No release dates (unknown by design, ADR-016).

Refs #295
@Seungpyo1007

Copy link
Copy Markdown
Member Author

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

13/13 categories ? 213,352 records ? diff base develop@0509867

Changed records in this PR

9220 record(s) assessed.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 0
    "Yellow" : 9220
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 934 0 934 0 0.0%
device_catalog 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 8286 0 8286 0 0.0%
All 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 9220 0 9220 0 0.0%

Full-dataset baseline

As of 2026-10-06T02:32:59Z (daily verify-status aggregate).

category total green yellow red
brand 2088 122 1966 0
soc 2117 284 837 996
smartphone 92824 18216 74555 53
tablet 3305 293 3011 1
watch 418 96 320 2
pda 112 80 32 0
gpu 2083 1536 547 0
cpu 4628 4340 287 1
laptop 1966 126 1840 0
monitor 231 3 228 0
software 42493 366 42127 0
website 40084 13420 26664 0
device_catalog 11783 0 11783 0
all 204132 38882 164197 1053

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit 7ac2a0d into develop Oct 6, 2026
5 checks passed
@Seungpyo1007

Copy link
Copy Markdown
Member Author

TechEngine change review: PASS

13/13 categories ? 213,352 records ? diff base develop@0509867

Check Result
python -m app.validate PASS
Changed dump JSON and manifest/index counts PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 934 0 0 0 934 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0
laptop 0 0 0 0 0 0
monitor 0 0 0 0 0 0
software 0 0 0 0 0 0
website 0 0 0 0 0 0
device_catalog 8286 0 0 0 8286 0

Changed record examples

brand added

  • brand/unknown/1xbet.json - 1XBET
  • brand/unknown/3222222-satelital.json - 3222222 Satelital
  • brand/unknown/3go.json - 3Go
  • brand/unknown/3q.json - 3Q
  • brand/unknown/4good.json - 4good
  • brand/unknown/7eleven.json - 7Eleven
  • brand/unknown/7mobile.json - 7mobile
  • brand/unknown/9mobile.json - 9mobile
  • brand/unknown/abans.json - Abans
  • brand/unknown/abilia.json - ABILIA
  • brand/unknown/access.json - Access
  • brand/unknown/aceson.json - Aceson
  • brand/unknown/acet.json - Acet
  • brand/unknown/ackees.json - ACKEES
  • brand/unknown/adth.json - ADTH
  • ... 919 more

device_catalog added

  • device_catalog/10-or/10-or-tcl-60-xe-nxtpaper-5g.json - TCL 60 XE NXTPAPER 5G
  • device_catalog/1xbet/1xbet-1xphone.json - 1XPHONE
  • device_catalog/3222222-satelital/3222222-satelital-g706.json - G706
  • device_catalog/3go/3go-gt10k3ips.json - GT10K3IPS
  • device_catalog/3go/3go-gt70053g.json - GT70053G
  • device_catalog/3go/3go-gt7007eqc.json - GT7007EQC
  • device_catalog/3q/3q-oc1020a.json - OC1020A
  • device_catalog/3rtablet/3rtablet-vt-7a-pro.json - VT-7A Pro
  • device_catalog/3rtablet/3rtablet-vt-7ga.json - VT-7GA
  • device_catalog/4good/4good-a103.json - A103
  • device_catalog/4good/4good-light-b100.json - 4GOOD Light B100
  • device_catalog/7eleven/7eleven-in265.json - IN265
  • device_catalog/7mobile/7mobile-drena.json - DRENA
  • device_catalog/7mobile/7mobile-kamba-2.json - Kamba 2
  • device_catalog/7mobile/7mobile-kamba.json - KAMBA
  • ... 8271 more

Heuristic review

  • Added records by manufacturer/brand: hisense: 169, coolpad: 123, prestigio: 104, fly: 99, logicom: 98, cherry-mobile: 84, dexp: 82, itel: 79

  • Added records by source class: other: 9220

  • Heuristic warnings: 3 total; showing first 3.

    • brand: brand/unknown/xing-xing.json: repeated adjacent word in name
    • device_catalog: device_catalog/lenovo/lenovo-tbd.json: placeholder-like token in name
    • device_catalog: device_catalog/tcl/tcl-tbd.json: placeholder-like token in name

@Seungpyo1007

Copy link
Copy Markdown
Member Author

TechEngine validation stats: PASS

13/13 categories ? 213,352 records ? diff base develop@0509867

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 3022 123 2899 0 3022 4.1%
soc 2117 284 1833 0 2117 13.4%
smartphone 92824 17235 75589 0 92824 18.6%
tablet 3305 293 3012 0 3305 8.9%
watch 418 98 320 0 418 23.4%
pda 112 68 44 0 112 60.7%
gpu 2083 1496 587 0 2083 71.8%
cpu 4628 4222 406 0 4628 91.2%
laptop 1966 129 1837 0 1966 6.6%
monitor 231 21 210 0 231 9.1%
software 42493 358 42135 0 42493 0.8%
website 40084 14721 25363 0 40084 36.7%
device_catalog 20069 0 20069 0 20069 0.0%
all 213352 39048 174304 0 213352 18.3%

Warning

Tracked verified coverage is below 50% for device_catalog 0.0% (0/20069), software 0.8% (358/42493), brand 4.1% (123/3022), laptop 6.6% (129/1966), tablet 8.9% (293/3305), monitor 9.1% (21/231), soc 13.4% (284/2117), all 18.3% (39048/213352), and 3 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base, changed records only)
loaded CPU=0 GPU=0
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 0
CPU cross-source ratio outliers (possible wrong-variant) 0
GPU cross-source ratio outliers + sanity 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Data collection: new records (workstream)

2 participants