These are chat archives for nextflow-io/nextflow
process.scratch=truein your nextflow scripts
process.scratch=trueis used, does a pipeline still need to be launched from a folder shared with all cluster workers? I.E. does that directive simply specify the folder for the worker to run in, or does that trigger a copy of all job related scripts to the scratch folder on the worker?
beforeScriptdirective just run on the master node, or does it run on all the workers as well? Right now I'm thinking in terms of
inputdefines all possible files to be processed,
whendecides which files actually need to be processed. In the
beforeScriptdirective it would be nice to look at how many items passed
whenand issue a cluster resize. Is this possible?
beforeScriptas a prolog of your command script
moreFiles = Channel.fromPath( 'data/**/.fa' )from the example on the Channels page be
moreFiles = Channel.fromPath( 'data/**/*.fa' )? It looks like to me
moreFiles = Channel.fromPath( 'data/**/.fa' )would only emit files named
.fain sub-folders of data.