These are chat archives for CommBank/maestro
Morning guys, feedback from Andre at concurrent:
things are a bit slower, than I expected, but I am getting there. Chris was travelling all of last week so we could only catch up yesterday to discuss some things that have to be done in Cascading itself, to make the partitioning work. (Hive does not discover partitions by itself, you have to register them as they appear and for that to work in a maintainable way, I had to open up an Cascading internal API). I am going to make the Cascading 2.6-wip builds public today and that will be the requirement for cascading-hive in order to get the partitioning to work. The partitioning support in cascading-hive will be pushed to github later today, so you can give it a try.
For the parquet discussion: We would prefer if you guys could keep the ebeneezer/scalding deps. in a project, which you maintain, so that we can limit our dependencies to a minimum. Please let me know, if that works for you.