These are chat archives for thunder-project/thunder

28th
Apr 2015
Joseph Winston
@josephwinston
Apr 28 2015 00:53
@freeman-lab when using Spark, I would normally do one of two (k, v) schemes.
  1. Each point in the cube is given a key of (i,j,k). While making the extraction of subsets like planes very easy, it isn't very space efficient
  2. Each record is given an (i,j) key. Map functions know have to iterate, which isn't very pretty at all
    I'm hoping that thunder has a better idea that what I've come up with so that I can extract planes out of the collection of series.