These are chat archives for thunder-project/thunder

Nov 2015
Nov 28 2015 21:28
@freeman-lab It seems that the npartitions argument is over-ruled by the lesser number of images or cores rule. I am loading a single, multiplane tiff file with 2000ish planes within the file. When I have 8 cores running and use npartitions=8, calling data.rdd.getNumPartitions() still returns 1. This is also true when I do it with 16 cores and use npartitions=16 and all the processing is done on one core.
I'll include this on the issue I include about multiplane tiffs, unless this seems that it shouldn't be the case and I am loading it incorrectly somehow.