These are chat archives for nextflow-io/nextflow

5th
Feb 2018
Bioninbo
@Bioninbo
Feb 05 2018 10:47
Hello. I was wondering if we can indicate the nextflow.config file that we want the resume option to always be true. I have tried workflow.resume, params.resume or process.resume but none of them worked.
Paolo Di Tommaso
@pditommaso
Feb 05 2018 10:51
almost there .. use resume=true
Bioninbo
@Bioninbo
Feb 05 2018 10:54
Hehe didn't considered it would be that simple. Thanks!
Maarten van Gompel
@proycon
Feb 05 2018 16:41
Question: I have a channel and I want to subdivide it into N batches, like that would be like a channel.buffer( size: total/N, remainder: true) operation , but that won't work on the fly of course as the channel needs to be finished first in order to get the total. What would be the most elegant way to accomplish this?
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:43
no way to predict the total ?
Maarten van Gompel
@proycon
Feb 05 2018 16:43
not really no :/
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:43
we have a problem if so ..
you will need to use an estimated size if you want to launch in parallel
Maarten van Gompel
@proycon
Feb 05 2018 16:44
hmm, I might actually still be able to derive it from the input files
yeah, a Channel.fromPath().count() would work then right?
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:47
if you need to use that value as size parameter you need Channel.fromPath().count().val
Maarten van Gompel
@proycon
Feb 05 2018 16:48
ah right , otherwise I get a channel, thanks! I'll go try :)
I'm promoting Nextflow in the dutch NLP community btw ;) quite like it
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:49
:clap: :clap: :clap: :clap:
Vladimir Kiselev
@wikiselev
Feb 05 2018 17:33
@apeltzer , yes it is MacOS