fix(data): add source citations for 13 tablet/watch records - #346
Merged
Merged
Conversation
Upgrade uncited tablet/watch records from dataset-only provenance to source-verified by confirming the stored specs field-by-field against authoritative sources (Wikipedia infoboxes, manufacturer/GSMArena spec pages) and setting verified:true. Existing dataset provenance URLs are retained alongside the new sources. No value was invented. Tablets (7): - Samsung Galaxy Tab S11, Tab S11 Ultra (Wikipedia) - Samsung Galaxy Tab S10 Ultra, Tab S10+ (Wikipedia) - Samsung Galaxy Fold, Galaxy Z Fold 6 (Wikipedia) - Amazon Kindle Fire (2011) (Amazon Fire tablet Wikipedia; already cited) Watches (6): - Google Pixel Watch 4 41mm, 45mm (Wikipedia; already cited) - Samsung Galaxy Watch Ultra, Watch 7, Watch 6 (Wikipedia) Value corrections to match the cited source (never invented): - Microsoft Surface 2 os "Windows Mobile" -> "Windows RT 8.1" - Galaxy Watch 7 storage_options [2,32] -> [32] (spurious 2 GB removed) - Galaxy Watch 6 storage_options [2,16] -> [16] (spurious 2 GB removed) Refs #296
Regenerate the static v1 dump for the tablet and watch detail pages affected by the source-citation pass (python -m app.dump from TechEngine against this worktree's data, fresh scratch DATABASE_URL). Picks up verified:true, the added Wikipedia sources, and the value corrections for the newly cited records. Unrelated scoring/updated_at drift for other categories was excluded to keep the PR scoped. Refs #296
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Upgrades uncited
data/tablet/anddata/watch/records from dataset-onlyprovenance (Kaggle / aitoolbuzz / GSMArena-scrape / GitHub) to
source-verified by confirming the stored specs field-by-field against
authoritative sources (Wikipedia infoboxes, manufacturer / GSMArena spec
pages) and setting
verified: true. Existing dataset provenance URLs areretained alongside the new sources. No value was invented and no citation
was fabricated.
Methodology
data/tablet/anddata/watch/live for records withverified != true. None had emptysource_urls— every record alreadycarried a bulk-dataset link, so the gap was uncited, not unsourced.
Live scope: tablet 3305 total / 3020 unverified;
watch 418 total / 325 unverified.
(RAM, battery, weight, OS, SoC, storage) can be confirmed against a
dedicated Wikipedia infobox or manufacturer/GSMArena spec page.
present) and set
verified: true.source (never invented) and cited it.
are rate-limited/unfetchable, phonedb entries marked "preliminary" or
contradicting the stored RAM, or generic dataset configs whose values
cannot be pinned to one authoritative page) -> left as-is, uncited.
Counts
Records touched: 13 (8 tablet + 5 watch)
Newly cited-and-verified (no value change): 10
Tab S10+, Galaxy Fold, Galaxy Z Fold 6, Amazon Kindle Fire (2011).
Samsung Galaxy Watch Ultra.
Value-corrected-with-citation: 3
os"Windows Mobile" -> "Windows RT 8.1" (Wikipedia)storage_options_gb[2, 32] -> [32] (spurious 2 GB removed; Wikipedia)storage_options_gb[2, 16] -> [16] (spurious 2 GB removed; Wikipedia)Left uncited (no confirmable source in this pass): 3312
(3012 tablet + 300 watch) — remaining bulk-dataset records not
individually confirmed in this batch; untouched, keep existing provenance.
Many cite GSMArena/phonedb pages that are strong follow-up candidates once
fetchable.
Verification
python -m app.validate-> passed.python integrity_check.py <data> --strict-> "integrity gate: no hardanomalies" (no verified-without-sources, no dup/slug issues).
python -m app.dumpfrom TechEngine againstthis worktree (fresh scratch
DATABASE_URL,TECHAPI_DATA_DIR-> thisworktree
data/) as the final commit; tablet/watch detail pages reflectthe new citations and corrections. Unrelated scoring /
updated_atdriftfor other categories was excluded to keep the PR scoped.
Refs #296