These are chat archives for thunder-project/thunder

17th
Aug 2015
Vijay Mohan K Namboodiri
@vjlbym
Aug 17 2015 15:56
This message was deleted

Hey all,

I have been getting a weird issue when trying to run Thunder image registration and subsequent ICA on EC2. I posted this as an issue on Github at thunder-project/thunder#223 The issue is that the speed of the job doesn't seem to be affected by the number of slaves I have in the cluster. Is there a specific way in which I should load the images to use all available nodes?

Thanks a lot!

Jeremy Freeman
@freeman-lab
Aug 17 2015 16:00
hey @vjlbym ! thanks for checking in, I saw that issue but haven’t had time to do some testing yet
would you mind adding to the issue the rough dimensions of the data? that way we can test exactly your workflow with comparable data
just the rough x by y by t is plently
Vijay Mohan K Namboodiri
@vjlbym
Aug 17 2015 16:07
Yeah, I'll add that in. I could also make the data publicly available on S3. The x by y by t is roughly 250 by 250 by 10000. Thanks a lot!
Jeremy Freeman
@freeman-lab
Aug 17 2015 16:08
oh, making a sample public would be even better!
terrific
Vijay Mohan K Namboodiri
@vjlbym
Aug 17 2015 16:10
I'll post the link on the issue page so you have it all in the same place. Thanks a lot again @freeman-lab !
Actually, the link is already in the code I posted. It's being made public right now. Takes a while for all the files. Thanks again!