Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
80 commits
Select commit Hold shift + click to select a range
061f2fb
Update version for updateblastdb (#8181)
SPPearce Apr 1, 2025
b1966f3
Change FastQC memory parameter from float to int (#8180)
Schmytzi Apr 1, 2025
16d40ec
updated bandage image to latest version (#8185)
saramonzon Apr 1, 2025
1a10aef
portcullis/full: accommodate more outputs (#8166)
anoronh4 Apr 1, 2025
af80d3e
update freyja module to latest version (#8184)
saramonzon Apr 1, 2025
c9c3ef8
Update bcftools (#8182)
saramonzon Apr 1, 2025
bf8db25
updated artic to latest version (#8186)
saramonzon Apr 2, 2025
12a91a4
Add functionality for `--unknown-slide` in `spaceranger/count` (#7233)
fasterius Apr 2, 2025
9fe7867
Add threads parameter for all seqkit modules missing (#8192)
jfy133 Apr 2, 2025
25c228d
Support formula in `abundance_differential_filter` and associated mod…
atrigila Apr 2, 2025
0d290ba
Update shinyngs modules (#8194)
pinin4fjords Apr 2, 2025
7658b57
add module integronfinder (#8131)
nguyent-son Apr 2, 2025
8d21f48
add gpu snapshot updater action (#8183)
mashehu Apr 3, 2025
00691a4
Update dependency python to 3.13 (#8189)
renovate[bot] Apr 3, 2025
a84e5d6
Mindagap stub and test updates (#8200)
kbestak Apr 3, 2025
84c05b8
fixed bug in bandage/image module, wrong versions.yml outputted (#8196)
saramonzon Apr 3, 2025
7775999
fix formatting in sylphtax/taxprof (#8202)
mashehu Apr 3, 2025
bd2f4e2
run update snapshot on gpu runners (#8201)
mashehu Apr 3, 2025
5b3b6d2
add nf-test and stub to svtk/standardize (#7768)
kubranarci Apr 3, 2025
d14e5f4
fix typo in gpu-snapshot updater (#8204)
mashehu Apr 3, 2025
7452092
update vep to 113.4 and redo conda tests (#8205)
nvnieuwk Apr 3, 2025
bbd58fe
Fix one more typo (#8207)
mashehu Apr 3, 2025
89e14c5
change MUSE_SUMP to high memory module (#8212)
famosab Apr 4, 2025
1fb0009
Update tj-actions/changed-files digest to 6cb76d0 (#8217)
renovate[bot] Apr 5, 2025
5b22bfa
Fix: PoolSNP: Update input tuple; cleanup stub (#8218)
abhilesh Apr 6, 2025
a9d1fd8
Fix to rnaseq preprocessing linting fix (#8221)
pinin4fjords Apr 7, 2025
dbf4962
Update modkit and porechop modules (#8223)
jkh00 Apr 7, 2025
bfb3c8e
Metaspace download (#8145)
Dewey-Wang Apr 7, 2025
962222a
Update vrhyme modules, including nf-test (#8163)
SPPearce Apr 7, 2025
ccc48a2
nf-test migration: cellrangerarc/count (#8008)
ignatiusm Apr 8, 2025
635aec1
Add sylphtax/merge and update taxprof to version 1.2 (#8228)
sofstam Apr 8, 2025
2fde6ce
Clair3 (#7838)
robert-a-forsyth Apr 8, 2025
a81612b
update to doubled runner resources (#8233)
mashehu Apr 8, 2025
0af81a2
GTDBTK_CLASSIFYWF database improvement (#8220)
jfy133 Apr 8, 2025
aaf475a
handle filtered out modules and subworkflow files in the linting step…
mashehu Apr 8, 2025
f283e84
fix linting check to run on files, not general changes (#8240)
mashehu Apr 8, 2025
1747557
always commit changes when run gpu-snapshot bot runs succesfully (#8237)
mashehu Apr 8, 2025
f5a4349
Plink2 hwe (#8227)
jodennehy Apr 8, 2025
188528e
migrate nf-test: survivor-filter (#8229)
kubranarci Apr 8, 2025
7d163ad
ragtag/scaffold and ragtag/patch modules and tests (#8198)
nschan Apr 8, 2025
b39324b
Nf-test migration survivor/simsv (#8251)
kubranarci Apr 9, 2025
457998a
Stecfinder nftest (#8243)
SPPearce Apr 9, 2025
a97cba2
Fix mutect tests (#8242)
famosab Apr 9, 2025
cb26bdc
nf-test migration: plink/indeppairwise (#8133)
mantisps Apr 9, 2025
62775d9
Uncomment logging. (#8248)
nschan Apr 9, 2025
9000de7
Swap shigeifinder to nf-test (#8245)
SPPearce Apr 9, 2025
3aff787
Migrate `cellrangerarc/mkref`to nf-test (#8219)
max-laurent Apr 9, 2025
ab28100
Plink2 filter (#8247)
jodennehy Apr 9, 2025
0334a68
Use modules_testdata_base_path (#8259)
maxulysse Apr 10, 2025
9eba633
nf-test + stub: svtk/rdtest2vcf (#8258)
kubranarci Apr 10, 2025
04f8865
dragmap hashtable - snapshot versions (#8261)
maxulysse Apr 10, 2025
0da0771
Add gatk4/modelsegments (#8234)
lbeltrame Apr 10, 2025
6f63af2
Update GTDB-TK: Update container version and fix a couple of error so…
prototaxites Apr 10, 2025
ab86221
Add custom adapters list as input argument (#8262)
sofstam Apr 10, 2025
5ae42c8
Update GitHub Actions (#8253)
renovate[bot] Apr 10, 2025
2533bac
Migrate `GENOTYPHI_PARSE` to nf-test (#8265)
LouisLeNezet Apr 10, 2025
956a7c2
Fix prettier porechop meta (#8266)
sofstam Apr 10, 2025
ed18984
Fix errant bash comment in gtdbtk/classifywf (#8267)
prototaxites Apr 10, 2025
8b06d86
Downgrade dragmap to the previous functionning version (#8263)
maxulysse Apr 10, 2025
5781b9e
new module: fusioncatcher build (#8268)
nvnieuwk Apr 11, 2025
2a227f7
new module: fusioncatcher/fusioncatcher (#8271)
nvnieuwk Apr 11, 2025
7dd4b71
Deprecate `FCS_FCSGX` (#8269)
LouisLeNezet Apr 11, 2025
800bb0e
Migrate `gem2/gem2bedmappability` to nf-test (#8275)
LouisLeNezet Apr 11, 2025
f94e439
Migrate `gem2/gemmappability` to nf-test (#8278)
LouisLeNezet Apr 11, 2025
5ce6815
Migrate `genescopefk` to nf-test (#8277)
LouisLeNezet Apr 11, 2025
fa55ebb
gatk4spark - better assertion and stub tests (#8274)
maxulysse Apr 11, 2025
e29af56
Links (#8260)
nschan Apr 11, 2025
17ae7a4
Migrate `damageprofiler` to nf-test (#8282)
LouisLeNezet Apr 11, 2025
0af0b33
Bump genmod to 3.10 (#8281)
fellen31 Apr 11, 2025
643c5d7
remove plink2 hwe (#8280)
jodennehy Apr 11, 2025
97d0461
Update tnscope and tnhaplotyper2
SPPearce Apr 11, 2025
b420233
Migrate `genmap/map` to nf-test (#8279)
LouisLeNezet Apr 11, 2025
e1e9cdb
Merge branch 'master' into sention_tnhaplotyper2_nftest
SPPearce Apr 11, 2025
642837d
Remove ultra/index
SPPearce Apr 11, 2025
4a64527
Remove empty config
SPPearce Apr 11, 2025
5a0d45d
Reset pytest_modules
SPPearce Apr 11, 2025
82dc013
Fix meta
SPPearce Apr 11, 2025
6297dbc
Reorder meta
SPPearce Apr 11, 2025
f228f07
Update modules/nf-core/sentieon/tnhaplotyper2/tests/main.nf.test
SPPearce Apr 11, 2025
b1b40de
Add env block
SPPearce Apr 11, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
12 changes: 2 additions & 10 deletions .github/actions/nf-test-action/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ inputs:
runs:
using: "composite"
steps:
- uses: actions/setup-java@3a4f6e1af504cf6a31855fa899c6aa5355ba6c12 # v4
- uses: actions/setup-java@c5195efecf7bdfc987ee8bae7a71cb8b11521c00 # v4
with:
distribution: "temurin"
java-version: "17"
Expand All @@ -30,22 +30,14 @@ runs:
- name: Set up Python
uses: actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55 # v5
with:
python-version: "3.11"
python-version: "3.13"

- name: Set up nf-test
uses: nf-core/setup-nf-test@v1
with:
version: "${{ env.NFT_VER }}"
install-pdiff: true

- name: Install dependencies from universe repo
if: contains(inputs.profile, 'singularity')
shell: bash
run: |
sudo add-apt-repository universe
sudo apt-get update
sudo apt-get install -y uidmap squashfs-tools

- name: Setup apptainer
if: contains(inputs.profile, 'singularity')
uses: eWaterCycle/setup-apptainer@3f706d898c9db585b1d741b4692e66755f3a1b40 #v2
Expand Down
8 changes: 5 additions & 3 deletions .github/skip_nf_test.json
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@
"modules/nf-core/cellranger/mkvdjref",
"modules/nf-core/cellranger/multi",
"modules/nf-core/cellranger/vdj",
"modules/nf-core/cellrangerarc/mkref",
"modules/nf-core/cellrangerarc/count",
"modules/nf-core/cellrangerarc/mkgtf",
"modules/nf-core/checkqc",
"modules/nf-core/coreograph",
Expand All @@ -31,7 +33,6 @@
"modules/nf-core/deepvariant/rundeepvariant",
"modules/nf-core/deepvariant/vcfstatsreport",
"modules/nf-core/doubletdetection",
"modules/nf-core/ensemblvep/vep",
"modules/nf-core/fastk/fastk",
"modules/nf-core/fastk/histex",
"modules/nf-core/fastk/merge",
Expand Down Expand Up @@ -74,6 +75,8 @@
"modules/nf-core/spaceranger/mkref",
"modules/nf-core/spotiflow",
"modules/nf-core/svanalyzer/svbenchmark",
"modules/nf-core/svtk/rdtest2vcf",
"modules/nf-core/svtk/standardize",
"modules/nf-core/universc",
"modules/nf-core/vt/decompose",
"modules/nf-core/wittyer",
Expand All @@ -85,8 +88,7 @@
"subworkflows/nf-core/deepvariant",
"subworkflows/nf-core/fasta_newick_epang_gappa",
"subworkflows/nf-core/fastq_align_bamcmp_bwa",
"subworkflows/nf-core/fastq_align_bwa",
"subworkflows/nf-core/vcf_annotate_ensemblvep"
"subworkflows/nf-core/fastq_align_bwa"
],
"docker": ["modules/nf-core/parabricks", "subworkflows/nf-core/deepvariant/tests/equality"],
"singularity": [
Expand Down
22 changes: 9 additions & 13 deletions .github/workflows/lint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -85,28 +85,24 @@ jobs:
with:
script: |
return [...new Set(${{ steps.filter.outputs.modules_files }}
.filter(x => x.endsWith('main.nf'))
.map(path => path
.replace('modules/nf-core/', '')
.split('/')
.slice(0, 2)
.filter(x => !x.startsWith('main.nf') && x !== 'tests' && x !== 'templates' && x !== 'meta.yml' && x !== 'environment.yml' && !x.endsWith('.md'))
.join('/'))
.replace(/\/main\.nf$/, '')
)
];
)];
- name: Get subworkflow name
uses: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea # v7
id: subworkflow_names
with:
script: |
return [...new Set(${{ steps.filter.outputs.subworkflows_files }}
.filter(x => x.endsWith('main.nf'))
.map(path => path
.replace('subworkflows/nf-core/', '')
.split('/')
.slice(0, 2)
.filter(x => !x.startsWith('main.nf') && x !== 'tests' && x !== 'templates' && x !== 'meta.yml' && x !== 'environment.yml' && !x.endsWith('.md'))
.join('/'))
.replace(/\/main\.nf$/, '')
)
];
)];

- name: debug
run: |
Expand All @@ -122,7 +118,7 @@ jobs:
- image=ubuntu22-full-x64
name: nf-core lint modules
needs: nf-core-changes
if: ${{ (needs.nf-core-changes.outputs.modules == 'true') }}
if: ${{ needs.nf-core-changes.outputs.modules_files != '[]' }}
strategy:
fail-fast: false
matrix:
Expand All @@ -149,7 +145,7 @@ jobs:
- name: Install pip
run: python -m pip install --upgrade pip

- uses: actions/setup-java@3a4f6e1af504cf6a31855fa899c6aa5355ba6c12 # v4
- uses: actions/setup-java@c5195efecf7bdfc987ee8bae7a71cb8b11521c00 # v4
with:
distribution: "temurin"
java-version: "17"
Expand All @@ -170,7 +166,7 @@ jobs:
- image=ubuntu22-full-x64
name: nf-core lint subworkflows
needs: nf-core-changes
if: ${{ (needs.nf-core-changes.outputs.subworkflows == 'true') }}
if: ${{ needs.nf-core-changes.outputs.subworkflows_files != '[]' }}
strategy:
fail-fast: false
matrix:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/nf-test-gpu.yml
Original file line number Diff line number Diff line change
Expand Up @@ -127,7 +127,7 @@ jobs:
confirm-pass-gpu:
runs-on:
- runs-on=${{ github.run_id }}-confirm-pass-gpu
- runner=4cpu-linux-x64
- runner=2cpu-linux-x64
- image=ubuntu22-full-x64
needs: [nf-test-gpu]
if: always()
Expand Down
8 changes: 3 additions & 5 deletions .github/workflows/pytest-workflow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -100,12 +100,8 @@ jobs:
tags: bwa/samse
- profile: conda
tags: cellpose
- profile: conda
tags: cellrangerarc/count
- profile: conda
tags: cellrangerarc/mkfastq
- profile: conda
tags: cellrangerarc/mkref
- profile: conda
tags: cellrangeratac/count
- profile: conda
Expand Down Expand Up @@ -228,6 +224,8 @@ jobs:
tags: subworkflows/fasta_clean_fcs
- profile: conda
tags: svanalyzer/svbenchmark
- profile: conda
tags: svtk/standardize
- profile: conda
tags: universc
- profile: singularity
Expand Down Expand Up @@ -255,7 +253,7 @@ jobs:
- name: Install Python dependencies
run: python -m pip install --upgrade pip pytest-workflow cryptography

- uses: actions/setup-java@3a4f6e1af504cf6a31855fa899c6aa5355ba6c12 # v4
- uses: actions/setup-java@c5195efecf7bdfc987ee8bae7a71cb8b11521c00 # v4
with:
distribution: "temurin"
java-version: "17"
Expand Down
99 changes: 99 additions & 0 deletions .github/workflows/update-gpu-snapshot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
name: update-gpu-snapshot
run-name: update gpu snapshot (automated)
on:
issue_comment:
types: [created]

env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
# renovate: datasource=github-releases depName=askimed/nf-test versioning=semver
NFT_VER: "0.9.2"
NXF_ANSI_LOG: false
# renovate: datasource=github-releases depName=nextflow/nextflow versioning=semver
NXF_VER: "24.10.2"

jobs:
update-gpu-snapshot:
# Only run if comment is on a PR with the main repo, and if it contains the magic keywords
if: >
contains(github.event.comment.html_url, '/pull/') &&
contains(github.event.comment.body, '@nf-core-bot update gpu snapshot') &&
github.repository == 'nf-core/modules'
runs-on: "runs-on=${{ github.run_id }}/family=g4dn.xlarge/image=ubuntu24-gpu-x64"
steps:
# indication that the snapshot is being updated
- name: React on comment
uses: peter-evans/create-or-update-comment@71345be0265236311c031f5c7866368bd1eff043 # v4
with:
comment-id: ${{ github.event.comment.id }}
reactions: eyes
# Use the @nf-core-bot token to check out so we can push later
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4
with:
token: ${{ secrets.nf_core_bot_auth_token }}

- name: Get the test path from the comment (after "@nf-core-bot update gpu snapshot path:")
id: get-test-path
run: |
echo "test_path=$(echo ${{ github.event.comment.body }} | grep -oP 'path:\s*\K[^ ]+')" >> $GITHUB_OUTPUT

- name: if test path is empty, exit
uses: peter-evans/create-or-update-comment@71345be0265236311c031f5c7866368bd1eff043 # v4
if: steps.get-test-path.outputs.test_path == ''
with:
comment-id: ${{ github.event.comment.id }}
reactions: "-1"

- name: if test path is empty, exit
if: steps.get-test-path.outputs.test_path == ''
run: exit 0

# Action runs on the issue comment, so we don't get the PR by default
# Use the gh cli to check out the PR
- name: Checkout Pull Request
run: gh pr checkout ${{ github.event.issue.number }}
env:
GITHUB_TOKEN: ${{ secrets.nf_core_bot_auth_token }}

- uses: actions/setup-java@c5195efecf7bdfc987ee8bae7a71cb8b11521c00 # v4
with:
distribution: "temurin"
java-version: "17"

- name: Set up Nextflow
uses: nf-core/setup-nextflow@v2
with:
version: "${{ env.NXF_VER }}"

- name: Set up Python
uses: actions/setup-python@8d9ed9ac5c53483de85588cdf95a591a75ab9f55 # v5
with:
python-version: "3.13"

- name: Set up nf-test
uses: nf-core/setup-nf-test@v1
with:
version: "${{ env.NFT_VER }}"
install-pdiff: true

- name: Update gpu snapshot
id: update-gpu-snapshot
run: |
nf-test test \
--profile=docker,gpu \
--verbose \
--ci \
--update-snapshot \
--filter process,workflow \
--tag gpu \
${{ steps.get-test-path.outputs.test_path }}

- name: Commit & push changes
run: |
git config user.email "[email protected]"
git config user.name "nf-core-bot"
git config push.default upstream
git add .
git status
git commit -m "[automated] Update gpu snapshot"
git push
4 changes: 2 additions & 2 deletions .github/workflows/wave.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:

- name: Find conda differences
id: conda-diff
uses: tj-actions/changed-files@823fcebdb31bb35fdf2229d9f769b400309430d0 # v46
uses: tj-actions/changed-files@ed68ef82c095e0d48ec87eccea555d944a631a4c # v46
with:
json: true
escape_json: false
Expand All @@ -40,7 +40,7 @@ jobs:

- name: Find Dockerfile differences
id: docker-diff
uses: tj-actions/changed-files@823fcebdb31bb35fdf2229d9f769b400309430d0 # v46
uses: tj-actions/changed-files@ed68ef82c095e0d48ec87eccea555d944a631a4c # v46
with:
json: true
escape_json: false
Expand Down
2 changes: 1 addition & 1 deletion modules/nf-core/artic/guppyplex/environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,4 @@ channels:
- conda-forge
- bioconda
dependencies:
- bioconda::artic=1.2.3
- bioconda::artic=1.6.2
4 changes: 2 additions & 2 deletions modules/nf-core/artic/guppyplex/main.nf
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ process ARTIC_GUPPYPLEX {

conda "${moduleDir}/environment.yml"
container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/artic:1.2.3--pyhdfd78af_0' :
'biocontainers/artic:1.2.3--pyhdfd78af_0' }"
'https://community-cr-prod.seqera.io/docker/registry/v2/blobs/sha256/5a/5a747cc579edfc0cb2176b749afc02550ab5de678ae6a40d2cfadeba6c0de25d/data' :
'community.wave.seqera.io/library/artic:1.6.2--d4956cdc155b8612' }"

input:
tuple val(meta), path(fastq_dir)
Expand Down
16 changes: 8 additions & 8 deletions modules/nf-core/artic/guppyplex/tests/main.nf.test.snap
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
]
],
"1": [
"versions.yml:md5,9ac5b3d9c4223377c632a78e7e727718"
"versions.yml:md5,2a341fa8dedc91b0567c7f0d2d2b06c6"
],
"fastq": [
[
Expand All @@ -22,15 +22,15 @@
]
],
"versions": [
"versions.yml:md5,9ac5b3d9c4223377c632a78e7e727718"
"versions.yml:md5,2a341fa8dedc91b0567c7f0d2d2b06c6"
]
}
],
"meta": {
"nf-test": "0.9.2",
"nextflow": "24.10.4"
"nextflow": "24.10.5"
},
"timestamp": "2025-03-01T21:05:25.082921858"
"timestamp": "2025-04-01T18:10:48.250223227"
},
"sarscov2 - fastq": {
"content": [
Expand All @@ -44,7 +44,7 @@
]
],
"1": [
"versions.yml:md5,9ac5b3d9c4223377c632a78e7e727718"
"versions.yml:md5,2a341fa8dedc91b0567c7f0d2d2b06c6"
],
"fastq": [
[
Expand All @@ -55,14 +55,14 @@
]
],
"versions": [
"versions.yml:md5,9ac5b3d9c4223377c632a78e7e727718"
"versions.yml:md5,2a341fa8dedc91b0567c7f0d2d2b06c6"
]
}
],
"meta": {
"nf-test": "0.9.2",
"nextflow": "24.10.4"
"nextflow": "24.10.5"
},
"timestamp": "2025-03-01T20:33:57.000960789"
"timestamp": "2025-04-01T18:10:05.440090167"
}
}
4 changes: 2 additions & 2 deletions modules/nf-core/artic/minion/environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,5 +4,5 @@ channels:
- conda-forge
- bioconda
dependencies:
- bioconda::artic=1.6.1
- bioconda::htslib=1.17
- bioconda::artic=1.6.2
- bioconda::htslib=1.17 # can't be updated due to dependency issues
4 changes: 2 additions & 2 deletions modules/nf-core/artic/minion/main.nf
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ process ARTIC_MINION {

conda "${moduleDir}/environment.yml"
container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/artic:1.6.1--pyhdfd78af_0' :
'biocontainers/artic:1.6.1--pyhdfd78af_0' }"
'https://community-cr-prod.seqera.io/docker/registry/v2/blobs/sha256/5a/5a747cc579edfc0cb2176b749afc02550ab5de678ae6a40d2cfadeba6c0de25d/data' :
'community.wave.seqera.io/library/artic:1.6.2--d4956cdc155b8612' }"

input:
tuple val(meta), path(fastq)
Expand Down
Loading
Loading