These are chat archives for
Sign in to start talking
A DSL for data-driven computational pipelines
Apr 14 2018 18:17 UTC
any recommendations for how to test a pipeline? I'm thinking something like isolating a process by defining test channels. or vice versa, and isolating a channel by defining a test process.
I suppose that subworkflow idea would also solve the testability puzzle
Paolo Di Tommaso
Apr 14 2018 21:42 UTC
Best practice consists in having a test test dataset and continuosly test it with a CI service like Travis or Circle
Apr 14 2018 23:06 UTC
Ok, thanks. But that would be like an integration test that would end-to-end for the whole pipeline. What about isolation like you would do in a unit test?