Skip to content
This repository was archived by the owner on Oct 24, 2026. It is now read-only.
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
132 commits
Select commit Hold shift + click to select a range
101c99e
[add] re-split lung datasets
Vghxv Nov 3, 2024
922985d
[add] preprocessing 📩
Vghxv Nov 3, 2024
26b477b
[add] add terms count and dbeta TSS data files for lung tissue analysis
Vghxv Nov 3, 2024
a14bde8
[add] add toml package dependency and update poetry.lock
Vghxv Nov 30, 2024
93ba08e
[add] add plotly and nbformat package dependencies
Vghxv Dec 2, 2024
450ba7f
add new analysis scripts for lung tissue data processing
Vghxv Dec 2, 2024
5344b9c
add configuration file for lung tissue analysis preprocessing parameters
Vghxv Dec 2, 2024
547142f
add google authentication package dependencies
Vghxv Dec 4, 2024
6fd7622
add .gitignore entries for pickle files and credentials
Vghxv Dec 4, 2024
55189ef
add utility functions for Google Drive authentication and file uploads
Vghxv Dec 4, 2024
c4e43ae
[update] result updates
Vghxv Dec 4, 2024
cb5de73
add global CONFIG_PATH variable to store configuration path
Vghxv Dec 4, 2024
a6e2cef
add gdown and related dependencies for Google Drive file downloads
Vghxv Dec 4, 2024
26ac01e
add error handling for Google Drive file operations
Vghxv Dec 4, 2024
36e8c8d
add configuration files for prostate, rectal, and stomach tissue data…
Vghxv Dec 4, 2024
6aa0cdb
[add] rectal GDC tissue 450K dbeta
xzh0623 Nov 14, 2024
3e16cbc
[add] rectal GDC tissue 450K filtering by TSS and threshold
xzh0623 Nov 14, 2024
1415760
[update] rectal GDC tissue 450K dbeta and filtering by TSS and threshold
xzh0623 Dec 11, 2024
ee91a05
[add] prostate Orange Pipeline
pizza6inch Dec 12, 2024
0422c24
[update] adjust training and testing sample sizes and class distribut…
Vghxv Dec 14, 2024
6f0252b
rewrite RFE
Vghxv Dec 15, 2024
f684c46
[add] add FPR, TPR, and results CSV files for lung tissue model evalu…
Vghxv Dec 15, 2024
937c52d
update RFE
Vghxv Dec 16, 2024
36191e5
[update] adjust training and testing sample sizes and class distribut…
Vghxv Dec 16, 2024
7a57d7a
improve function clearity, fix typos
Vghxv Dec 17, 2024
8e57de1
[update] lung with oversampling results
Vghxv Dec 17, 2024
5d6b4bf
fix dbeta calculation
Vghxv Dec 22, 2024
881d41e
[update] adjust lung configuration parameters for preprocessing and c…
Vghxv Dec 22, 2024
3c7cfbd
[update] update selected feature names for lung tissue models
Vghxv Dec 22, 2024
5e76df0
prostate with oversampling
pizza6inch Dec 23, 2024
adc1eb8
[update] add clustering and training utility functions, update lung c…
Vghxv Dec 23, 2024
03be337
[update] add new dbeta calculation results and selected feature names…
Vghxv Dec 23, 2024
f9e4c86
[update] enhance lung configuration and add combination utility funct…
Vghxv Dec 23, 2024
5b8128b
[update] ROC curve on testing
Vghxv Dec 24, 2024
881e316
update: handle division by zero in specificity calculation with warni…
Vghxv Jan 4, 2025
391d58b
fix: correct spelling of 'specificity' in record function
Vghxv Jan 4, 2025
d73985c
feat: add ROC curve and performance difference plotting functions
Vghxv Jan 4, 2025
76e4172
delete outdated results
Vghxv Jan 4, 2025
d5e71ae
feat: enhance hierarchical clustering functions to save plots and acc…
Vghxv Jan 4, 2025
73c91f2
lung no oversample metrics and results
Vghxv Jan 4, 2025
227da3d
feat: stucked
Vghxv Jan 4, 2025
27722bc
remove garbge
Vghxv Jan 5, 2025
9537732
feat: enhance function signatures with type hints and improve perform…
Vghxv Jan 5, 2025
51fef21
feat: add performance metrics and selected features for lung tissue m…
Vghxv Jan 5, 2025
7b481ea
general pipeline
Vghxv Jan 5, 2025
a799c66
combination
Vghxv Jan 6, 2025
5dfadb5
feat: add consensus selected features for lung tissue models, clean up
Vghxv Jan 6, 2025
fd3e8fa
feat: remove
Vghxv Jan 11, 2025
e9593e4
prostate ml
pizza6inch Jan 13, 2025
86b5eda
add ipynb
pizza6inch Jan 13, 2025
a47c484
prostate clustering
pizza6inch Jan 13, 2025
8110c38
fix: update type hints for hierarchical_clustering_compare function
Vghxv Jan 13, 2025
78473a7
feat: modules
Vghxv Jan 13, 2025
e39d9d1
rfe
Vghxv Jan 13, 2025
7523158
feat: rfe seleted feature names
Vghxv Jan 13, 2025
4318832
update modules
Vghxv Jan 14, 2025
8b996ab
feat: sfs pipeline
Vghxv Jan 14, 2025
e438252
sfs results
Vghxv Jan 14, 2025
33879b0
ignore log
Vghxv Jan 14, 2025
b5ee87f
feat: update selected feature names and add voting metrics
Vghxv Jan 15, 2025
d95f425
feat: selected gene cleaning
Vghxv Jan 17, 2025
5fe2118
fix naming
Vghxv Jan 17, 2025
b586fa3
feat: add training parameters for machine learning models
Vghxv Jan 18, 2025
930adb1
fix: create logs dir
Vghxv Jan 18, 2025
c444856
fix confusion
Vghxv Jan 18, 2025
3240377
fix stupid logic
Vghxv Jan 18, 2025
106bc3d
Merge branch 'lung' into prostate
pizza6inch Feb 2, 2025
d4c1d06
testing
pizza6inch Feb 3, 2025
2e6da13
workflow done
Vghxv Feb 3, 2025
856379d
new rfe sfs results
Vghxv Feb 3, 2025
c27b6bd
lung results
Vghxv Feb 6, 2025
e41903b
final polish
Vghxv Feb 6, 2025
2fc0dcd
remove old files
Vghxv Feb 6, 2025
a712d22
add cat
Vghxv Feb 6, 2025
54b6e5e
update lock file
Vghxv Feb 6, 2025
834c69a
Revert "update lock file"
Vghxv Feb 6, 2025
37ed86b
refactor configuration and notebook to streamline data file references
Vghxv Feb 6, 2025
0651ec0
remove unused function to clean up dataset processing code
Vghxv Feb 6, 2025
31413a3
add README.md for configuration details and data processing parameters
Vghxv Feb 6, 2025
d223c23
Merge branch 'lung' into prostate
pizza6inch Feb 7, 2025
d527c5c
[RFE] select2-6 & select 1-5
OuChiaYun Feb 8, 2025
e9bf94a
[RFE] select 1-5
OuChiaYun Feb 8, 2025
9a89081
[add] result before sfs(section 3)
xzh0623 Feb 8, 2025
48f35ed
[update] result before sfs(section 3)
xzh0623 Feb 8, 2025
7acba4e
GDC_prostate_tissue pipeline result
pizza6inch Feb 9, 2025
78101d3
delete previous result
pizza6inch Feb 9, 2025
25040d5
GSE269244 result
pizza6inch Feb 9, 2025
3870b9e
[add] selected features using SFS and RFE
xzh0623 Feb 9, 2025
8e97d85
[add] section 6
xzh0623 Feb 9, 2025
7f4af77
[add] section 6 (SFS result)
xzh0623 Feb 9, 2025
c2616a7
GDC with oversample
pizza6inch Feb 10, 2025
520c9cf
rfe 1-5 planA
OuChiaYun Feb 14, 2025
07ae05a
[update] best combination result using GDC
xzh0623 Feb 15, 2025
b7a62c3
[add] Plan A stop (while selecting best comb)
xzh0623 Feb 15, 2025
33a5cfb
sfs planA
OuChiaYun Feb 16, 2025
1368384
sfs planA (toml)
OuChiaYun Feb 16, 2025
9e4bc95
rfe 1-5 planA
OuChiaYun Feb 16, 2025
ad750a7
config
OuChiaYun Feb 16, 2025
e1cacf2
sfs planA
OuChiaYun Feb 16, 2025
02d8bd0
rfe1-5 planA
OuChiaYun Feb 17, 2025
d6e5f9b
sfs & simpleModel training
pizza6inch Feb 17, 2025
faadd4a
rfe1-5 planA tmp
OuChiaYun Feb 17, 2025
206f62a
[update] Plan A
xzh0623 Feb 17, 2025
d72536d
some cool updates with plan A
Vghxv Feb 17, 2025
b5fabe1
typo
Vghxv Feb 18, 2025
b0dee9c
SFS planA
OuChiaYun Feb 18, 2025
03e63d7
Merge branch 'lung' into prostate/GSE269244
pizza6inch Feb 19, 2025
db56410
toml settings
pizza6inch Feb 19, 2025
50d5d34
Merge remote-tracking branch 'origin/lung' into breast-orangepipline
OuChiaYun Feb 19, 2025
9f3385e
RFE - other planA result(TCGA GEO)
OuChiaYun Feb 19, 2025
5cf91b8
Merge remote-tracking branch 'origin/lung' into stomach-orangepipline
OuChiaYun Feb 19, 2025
86dbdae
save combine result
OuChiaYun Feb 19, 2025
61aa74a
RFE other planA
OuChiaYun Feb 19, 2025
f3497f0
plan_A_section 2
pizza6inch Feb 20, 2025
3616659
renaming folders
Vghxv Feb 20, 2025
fc2259a
some updates
Vghxv Feb 20, 2025
cbf816a
set the index of the last row as "label" in split_dataset function
Vghxv Feb 22, 2025
43ac044
[add] Orange-pipeline plan A result (SMOTE oversample)
xzh0623 Feb 23, 2025
cc03af8
[update] champ env
Vghxv Dec 19, 2024
5619467
[revert] restore orchestrator notebook to lung base version
Vghxv Oct 17, 2026
e694693
[revert] restore orchestrator notebook to lung base version
Vghxv Oct 17, 2026
3d87258
[rename] add _oversample suffix to files conflicting with GSE269244
Vghxv Oct 17, 2026
b7e2aa1
[remove] accidentally committed config/breast.toml
Vghxv Oct 17, 2026
d1b06ab
Merge branch 'rectal-orangepipline' into orangepipeline-merged
Vghxv Oct 17, 2026
5bae65b
Merge branch 'stomach-orangepipline' into orangepipeline-merged
Vghxv Oct 17, 2026
f5518e2
Merge branch 'breast-orangepipline' into orangepipeline-merged
Vghxv Oct 17, 2026
ef69ffd
Merge branch 'prostate/GSE269244' into orangepipeline-merged
Vghxv Oct 17, 2026
4b90ec9
Merge branch 'prostate/GDC_prostate_tissue' into orangepipeline-merged
Vghxv Oct 17, 2026
c1ece84
Merge branch 'rectal_plan_A_results_SMOTE' into orangepipeline-merged
Vghxv Oct 17, 2026
2d4d4fa
Merge branch 'clean_up' into orangepipeline-merged
Vghxv Oct 17, 2026
10f9f11
Update r-utils-check workflow to enhance caching and upgrade checkout…
Vghxv Oct 17, 2026
ecbf2ba
Enhance r-utils-check workflow by adding environment variables for te…
Vghxv Oct 17, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
33 changes: 28 additions & 5 deletions .github/workflows/r-utils-check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,28 +2,51 @@ name: r-utils-check

on:
pull_request:
paths:
paths: &paths
- R-scripts/**
- renv/**
- .github/workflows/r-utils-check.yml
- renv.lock
# Run on master too so the renv cache is saved in the base-branch scope,
# where every PR can restore it (PR-scoped caches aren't shared across PRs).
push:
branches: [master]
paths: *paths
workflow_dispatch:

jobs:
test:
runs-on: ubuntu-latest
env:
TEST_PACKAGES: testthat abind rentrez AnnotationDbi org.Hs.eg.db GOSemSim

steps:
- name: Checkout repository
uses: actions/checkout@v3
with:
uses: actions/checkout@v4
with:
sparse-checkout: |
.github
R-scripts
renv
- name: Set up R
uses: r-lib/actions/setup-r@v2
- name: Set up renv
uses: r-lib/actions/setup-renv@v2
with:
# Match the R version in renv.lock so the cache key stays stable
r-version: renv
# Install prebuilt Linux binaries from Posit Package Manager instead of compiling
use-public-rspm: true
- name: Set renv cache path
run: echo "RENV_PATHS_ROOT=$HOME/.cache/R/renv" >> "$GITHUB_ENV"
- name: Cache renv packages
uses: actions/cache@v4
with:
path: ~/.cache/R/renv
# Package list lives in this file, so its hash covers TEST_PACKAGES changes
key: renv-v1-${{ runner.os }}-${{ hashFiles('renv.lock', '.github/workflows/r-utils-check.yml') }}
restore-keys: renv-v1-${{ runner.os }}-
- name: Restore test dependencies
run: |
Rscript -e 'renv::restore(packages = strsplit(Sys.getenv("TEST_PACKAGES"), " ")[[1]], prompt = FALSE)'
- name: Run tests
working-directory: ${{ github.workspace }}
run: |
Expand Down
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
/data_TNBC
/train
/champ_result
**/external_result
*.7z
*.gz
*.pptx
Expand Down
6 changes: 3 additions & 3 deletions R-scripts/parse.R
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
# nolint start
library(ChAMP)
myLoad <- champ.load("train/stage_III")#, SampleCutoff = 0.2)#, arraytype = "EPIC")
myLoad <- champ.load("data/TCGA_COAD_READ")#, SampleCutoff = 0.2)#, arraytype = "EPIC")

myNorm <- champ.norm(beta=myLoad$beta,plotBMIQ=FALSE,cores=5)#, arraytype = "EPIC")

write.csv(myNorm,file="all_beta_normalized_stage_450k_1213.csv",quote=F,row.names=T)
write.csv(myNorm,file="all_beta_normalized_TCGA_COAD_READ.csv",quote=F,row.names=T)

myDMP <- champ.DMP(beta=myNorm, pheno=myLoad$pd$Sample_Group)#, arraytype = "EPIC")

write.csv(myDMP[[1]], file="DMP_result_1213.csv", quote=F)
write.csv(myDMP[[1]], file="DMP_result_TCGA_COAD_READ.csv", quote=F)

# nolint end
Loading
Loading