Repository navigation
feat: integrate CANCER-SEEK ultra-sensitive pipeline + methylation cfRNA module (v2.3.0) - #7
Open
rollroyces wants to merge 25 commits into
Open
rollroyces wants to merge 25 commits into
rollroyces wants to merge 25 commits into
Conversation
… min_variants guard for TF estimate)
…sv for committed results/
…e for future advanced_fusion.py routing
…persistence input)
…ecting port-to-deepcatch state
…atch/docs/ultrasensitive/
…AP, register new packages
…tory + new limitations
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR consolidates the CANCER-SEEK ultra-sensitive screening scaffold from three sibling repos into the
rollroyces/deepcatchumbrella as v2.3.0:rollroyces/cancer-screening(archived) →src/ultrasensitive/+src/screening_policy/rollroyces/deepcatch-methylation(archived) →src/methylation/rollroyces/cfDNA-Fragmentomics(archived) → no port; redirected tosrc/fragmentomics/+ sister pipelineThe 189-test DeepCatch fast-path gate is not affected: the new modules are gated behind the optional
[ultra]extras.What ships in v2.3.0
New code (12 modules)
src/ultrasensitive/umi.py— UMI-based error correction (duplex consensus)src/ultrasensitive/variant_calling.py— low-VAF variant caller with CHIP filtersrc/ultrasensitive/cnv_analyzer.py— CNV CBS segmentation (bug fix:__Logger→__name__)src/ultrasensitive/methylation.py— beta-value methylation processor with DMR detectionsrc/ultrasensitive/xgboost_classifier.py— XGBoost + SHAP explanations (gated behind[ultra])src/ultrasensitive/methylation_encoder.py— Transformer encoder (architecture-only; real-data validation deferred to Phase 4)src/ultrasensitive/fusion_net.py— 4-modality FusionNet (reference; future routing throughmultimodal_fusion/)src/ultrasensitive/vae_anomaly.py— β-VAE anomaly detectorsrc/ultrasensitive/spike_in_simulator.py— spike-in LOD validator (CLI:deepcatch-lod)src/screening_policy/rl_agent.py— SAC-like RL agent + 10,000-patient simulated cohortsrc/methylation/cfrna_coupling.py— read-side companion tomrnavax-raresrc/methylation/methylation_reader.py— methylation-array → persistence-input normalizerNew docs
docs/CANCER_SEEK_ARCHITECTURE.md— system architecture for ultra-sensitive pipelinedocs/ROADMAP_CANCER_SEEK.md— 12-month integration roadmap with workstream statusesdocs/legacy/DATA_SCIENCE_ML.md— historical CANCER-SEEK ML reference (byte-for-byte port)docs/ultrasensitive/PHASE0_PLAN.md— methylation Phase 0 smoke validation planBuild updates
2.2.0→2.3.0[ultra]extras:xgboost,shap[ultra-rl]extras:stable-baselines3,gymnasiumdeepcatch-lodconsole script entry pointpytestmarkerultrasrc.ultrasensitive,src.screening_policy,src.methylationDoc updates
MODEL.mdbumped to v2.3.0 with v2.3.0 changelog, new modality list, new limitations 11–12README.mdbumped to v2.3.0 with new CANCER-SEEK callout, new module reference table row, new repo structure block, new CLI examplesTests (new)
test/test_ultrasensitive/__init__.py— 8 smoke-test stubs (UMI, CNV, variant caller, methylation, spike-in, XGBoost deps, ...),@pytest.mark.ultratest/test_methylation/__init__.py— 7 smoke tests for cfRNA coupling + reader contractWhy this consolidation
Splitting the research across four sibling repos (this one,
cancer-screening,deepcatch-methylation,cfDNA-Fragmentomics, the productioncfdna-fragmentomics-pipeline) made cross-cutting changes expensive and obscured the unified headline benchmark. Consolidating underdeepcatch:pip install -e .)deepcatch-methylation(cfRNA vs CpG / FinaleMe) by adopting the CpG track — which is also the one documented inMETHYLATION_PROJECT.md§9Test plan
Risk assessment
@pytest.mark.ultraso the fast-path gate is not affected. The CI badge in the README continues to describe189 passed, 12 deselected.fusion_net.pyduplicatessrc/multimodal_fusion/advanced_fusion.py(already migrated from sklearn-LR to PyTorch in Audit-2). Module docstring calls out the deprecation path.methylation_encoder.pyis architecture-only — reuses Python'stransformer_layerwithout a real-data checkpoint. Real-data validation is Phase 4 ofMETHYLATION_PROJECT.md.Migration / rollback
This is the only PR between v2.2.0 and v2.3.0. There are no breaking changes to the public API of any existing DeepCatch module — only additions under three new namespaces (
src.ultrasensitive,src.screening_policy,src.methylation) and the optional[ultra]extras dependency.To roll back:
git revertthis commit (or the merge commit) and re-tag v2.2.0 onmain. The sibling repos remain onmainwith their README archived-banners pointing back here.Companion-repo follow-ups
After merge:
rollroyces/cancer-screening,rollroyces/deepcatch-methylation,rollroyces/cfDNA-Fragmentomicsas archived via the GitHub admin panel (README redirects are already in place).rollroycesprofile repo (README.md) to point to the consolidated umbrella.v2.3.0Zenodo release once the existing fast-path gate passes on the merge commit.🤖 This PR was assembled by MiniMax Code on Royce's behalf with full provenance in the commit messages of
feat/cancer-seek-integrationand the workspaceMIGRATION_PLAN.md.