These are chat archives for freeman-lab/zebra

Mar 2015
Davis Bennett
Mar 30 2015 01:53
suppose I make a lot of one-off RDD's like this
stdVol = imDat.astype('float32').seriesStdev().pack().T
where imDat is rather large
since spark is lazy, I don't need to worry about any memory overhead issues relating to this RDD after I've packed it as a local array, right?