These are chat archives for nextflow-io/nextflow

5th
Feb 2018
Bioninbo
@Bioninbo
Feb 05 2018 10:47 UTC
Hello. I was wondering if we can indicate the nextflow.config file that we want the resume option to always be true. I have tried workflow.resume, params.resume or process.resume but none of them worked.
Paolo Di Tommaso
@pditommaso
Feb 05 2018 10:51 UTC
almost there .. use resume=true
Bioninbo
@Bioninbo
Feb 05 2018 10:54 UTC
Hehe didn't considered it would be that simple. Thanks!
Maarten van Gompel
@proycon
Feb 05 2018 16:41 UTC
Question: I have a channel and I want to subdivide it into N batches, like that would be like a channel.buffer( size: total/N, remainder: true) operation , but that won't work on the fly of course as the channel needs to be finished first in order to get the total. What would be the most elegant way to accomplish this?
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:43 UTC
no way to predict the total ?
Maarten van Gompel
@proycon
Feb 05 2018 16:43 UTC
not really no :/
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:43 UTC
we have a problem if so ..
you will need to use an estimated size if you want to launch in parallel
Maarten van Gompel
@proycon
Feb 05 2018 16:44 UTC
hmm, I might actually still be able to derive it from the input files
yeah, a Channel.fromPath().count() would work then right?
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:47 UTC
if you need to use that value as size parameter you need Channel.fromPath().count().val
Maarten van Gompel
@proycon
Feb 05 2018 16:48 UTC
ah right , otherwise I get a channel, thanks! I'll go try :)
I'm promoting Nextflow in the dutch NLP community btw ;) quite like it
Paolo Di Tommaso
@pditommaso
Feb 05 2018 16:49 UTC
:clap: :clap: :clap: :clap:
Vladimir Kiselev
@wikiselev
Feb 05 2018 17:33 UTC
@apeltzer , yes it is MacOS