These are chat archives for nextflow-io/nextflow

17th
Mar 2015
Andrew Stewart
@andrewcstewart
Mar 17 2015 20:08
hm
been quiet in here
Paolo Di Tommaso
@pditommaso
Mar 17 2015 20:21
Hi there, how do you do?
Sorry, I miss to reply to your question
Actually I was thinking that a solution could be having a non-blocking groupTuple but I haven't time to investigate that
Andrew Stewart
@andrewcstewart
Mar 17 2015 20:25
oh, no worries, just peeking in
that sounds cool though
sounds like it could be pretty powerful
especially w.r.t. nested parallelization
Paolo Di Tommaso
@pditommaso
Mar 17 2015 20:27
If the number of item in each group is know, it could be possible
BTW I'm working on the integration with ClusterK, I remember you were interested
It looks promising..
Andrew Stewart
@andrewcstewart
Mar 17 2015 20:29
I forget which one that is... in-memory cluster?
like Spark?
Paolo Di Tommaso
@pditommaso
Mar 17 2015 20:32
Cloud scheduler for spot instances
Andrew Stewart
@andrewcstewart
Mar 17 2015 20:34
ah right. This is commercial though?
I thought it was open source.
Paolo Di Tommaso
@pditommaso
Mar 17 2015 20:35
Yes, not open :/
Andrew Stewart
@andrewcstewart
Mar 17 2015 20:37
have you considered something like mesos?
Paolo Di Tommaso
@pditommaso
Mar 17 2015 20:38
would be nice but we don't plan to use it in the near future.
Also I don't think is very popular in bioinformatics
at lest in EU
You know people that's using it in production?
Andrew Stewart
@andrewcstewart
Mar 17 2015 20:46
Not in bioinformatics
but then again bioinformatics has a history of using the wrong tools :)
Paolo Di Tommaso
@pditommaso
Mar 17 2015 20:54
that is why it is special ;)