These are chat archives for ipython/ipython
@ellisonbg dask.distributed is a work in progress. Decent prototype code though http://dask.readthedocs.org/en/latest/distributed.html .
Deployment is an open question. People seem to want to interact with existing HDFS systems which sort of implies a need to interact with Yarn. I'd like to dodge this bullet. @cowlicks is looking into bootstrapping dask.distributed deployment given a ipparallel client/view . Was hoping to get you all to do the hard work :)