Skip to content

data(smartphone): import PhoneDB historic tail (1993-2009, ids 1-1587) - #29

Merged
Seungpyo1007 merged 5 commits into
mainfrom
data/phonedb-tail
Jun 19, 2026
Merged

Seungpyo1007 merged 5 commits into
mainfrom
data/phonedb-tail

Conversation

@Seungpyo1007

Copy link
Copy Markdown
Member

Summary

Completes the PhoneDB import range with the historic tail — device ids 1–1587 (years 1993–2009), which neither my earlier batches (#27 / #28, top range) nor the concurrent session had reached. +868 variant-level smartphones + 75 SoC seeds (all verified: false, per-record source_urls), plus a refreshed dump.

Changes vs main

  • +868 smartphones — Nokia 109, HTC 63, Samsung 62, Motorola 45, O2 39, i-mate 37, Palm/Qtek/Sony… (classic 2000s & early-smartphone era).
  • +75 SoC seeds.
  • site/public/v1 dump refreshed → 25,523 smartphones / 1,848 SoC.
  • Distinct per-batch commit messages + Refs #1 in each commit body.

Validation (local)

  • python -m app.validate → ✅ passed
  • python TechEngine/integrity_check.py data --strict → ✅ no hard anomalies
  • Built in an isolated git worktree off origin/main (+ dump from a fresh DB) to avoid a concurrent session's writes to the shared data/. Branch data/phonedb-tail is used instead of the contested data/import-staging.

Closes #1

@Seungpyo1007 Seungpyo1007 added enhancement New feature or request data Dataset changes labels Jun 19, 2026
@Seungpyo1007 Seungpyo1007 self-assigned this Jun 19, 2026
@Seungpyo1007

Copy link
Copy Markdown
Member Author

Validation review — PASS ✅

Commands (local): python -m app.validate ✅ · python TechEngine/integrity_check.py data --strict ✅ (no hard anomalies)
Data changes vs main: +868 smartphones, +75 SoC seeds, dump refreshed (→ 25,523 / 1,848).
Coverage: PhoneDB ids 1–1587 (years 1993–2009) — the historic tail not covered by #27/#28 or the concurrent session.
Example: data/smartphone/palm/2002/..., data/smartphone/nokia/... (early-smartphone / feature-phone era).
Heuristic warnings: none new (names normalized at scrape).
Build note: generated in an isolated git worktree off origin/main + fresh-DB dump, to avoid a concurrent session's writes to the shared data/.

@Seungpyo1007

Copy link
Copy Markdown
Member Author

Dataset stats (post-merge projection)

category total verified unverified verified %
smartphone 25,523 184 25,339 0.7%
soc 1,848 58 1,790 3.1%

Warning

Verified coverage is far below 50% — expected for bulk raw seed imports. Verification deferred to TechEngine / manual audit.

@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Jun 19, 2026
@Seungpyo1007
Seungpyo1007 merged commit 7cca8c7 into main Jun 19, 2026
4 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Jun 19, 2026
@Seungpyo1007
Seungpyo1007 deleted the data/phonedb-tail branch August 3, 2026 00:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

TechAPI dataset roadmap and status: all categories (1989-2026)

1 participant