These are chat archives for thunder-project/thunder

31st
Jul 2015
marta-grilo
@marta-grilo
Jul 31 2015 11:07
Hello guys :) i am trying to learn how to use the amazing thunder but I am having some troubles. I am testing the cross correlation and I have a .mat file with the 2 things i want to correlate. var1 are 250 60x60 images of a brain and var2 is a stimulus over time. how do i load this into thunder
in adition, i am not very fluent in python. thanks
Davis Bennett
@d-v-b
Jul 31 2015 22:34
@freeman-lab @andrewosh @jwittenbach if I have data in Series format on disk and I want to convert it to Images format, I have first run tsc.loadSeries and then toSeries, which is going to incur a shuffle. Would it be possible to have a loadSeriesAsImages method or something with only one disk I/O step?
Jeremy Freeman
@freeman-lab
Jul 31 2015 22:37
@d-v-b that’s quite complicated given the typical on-disk representation we’ve used for reading/writing Series data in parallel
but would defintiely be possible with alternative storage formats
Davis Bennett
@d-v-b
Jul 31 2015 22:41
the use case at hand is max projecting data after dff
Jeremy Freeman
@freeman-lab
Jul 31 2015 22:42
we might want to look into doing that on blocks
the shuffle from series back to images is especially bad now because it's been broken into so many small records