Skip to content

Commit ae8a2cf

Browse files
committed
markdown source builds
Auto-generated via {sandpaper} Source : 4012dc4 Branch : main Author : Graeme Grimes <graeme.grimes@ed.ac.uk> Time : 2024-08-21 14:10:52 +0000 Message : Merge pull request #160 from kubranarci/issue_127 add description for work directory
1 parent 4faad96 commit ae8a2cf

File tree

2 files changed

+3
-1
lines changed

2 files changed

+3
-1
lines changed

10-workflow_checkpoint_caching.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -86,6 +86,8 @@ You will see that the execution of the process `NUMLINES` is actually skipped (c
8686

8787
## How does resume work?
8888

89+
Nextflow stores all intermediate files and task results during the execution of a workflow is `work` directory. It acts as a scratch space where all the temporary data required for the workflow's execution is kept. Within the work directory, Nextflow creates subdirectories named with unique hashes (e.g., work/ab/cd1234...). Each of these subdirectories corresponds to a specific process or task in the pipeline. The hashed directory names ensure that each task's outputs are isolated and uniquely identified.
90+
8991
The mechanism works by assigning a unique ID to each task. This unique ID is used to create a separate execution directory, within the `work` directory, where the tasks are executed and the results stored. A task's unique ID is generated as a 128-bit hash number obtained from a composition of the task's:
9092

9193
- Inputs values

md5sum.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212
"episodes/07-operators.md" "3fd5fdf3e473d7418d6661788e002f23" "site/built/07-operators.md" "2024-04-23"
1313
"episodes/08-reporting.md" "f23f1e02ae63d3a8b427f2c5a59e09b9" "site/built/08-reporting.md" "2024-04-23"
1414
"episodes/09-configuration.md" "d835882c255b8619490892f3774863be" "site/built/09-configuration.md" "2024-06-10"
15-
"episodes/10-workflow_checkpoint_caching.md" "75ae09944b17cfbc94a10343d44b2114" "site/built/10-workflow_checkpoint_caching.md" "2024-07-22"
15+
"episodes/10-workflow_checkpoint_caching.md" "be281e6a4979f54f125de3e3f8395529" "site/built/10-workflow_checkpoint_caching.md" "2024-08-21"
1616
"episodes/11-Simple_Rna-Seq_pipeline.md" "f7991f20db41a44eb0839ebdb29bf151" "site/built/11-Simple_Rna-Seq_pipeline.md" "2024-06-10"
1717
"episodes/12-nfcore.md" "579c117af4986a471cbcd2e851e38463" "site/built/12-nfcore.md" "2024-07-22"
1818
"instructors/instructor-notes.md" "72b07147495ce6aeb50a90a2d64d67ed" "site/built/instructor-notes.md" "2024-01-16"

0 commit comments

Comments
 (0)