These are chat archives for CommBank/maestro

2nd
Apr 2015
Sam Roberts
@SamRoberts
Apr 02 2015 00:05
thanks vineeth
Rowan Davies
@rowandavies
Apr 02 2015 00:27
If anyone wants a small task, maybe review the modest changes in the README #347.
Sam Roberts
@SamRoberts
Apr 02 2015 00:29
will take a look after finishing with vineeth's PR
Luke Williams
@shmookey
Apr 02 2015 00:42
sorry guys, flight has been delayed twice, might only make it for the end of the day :/
Rowan Davies
@rowandavies
Apr 02 2015 00:57
@SamRoberts A couple of comments, but #351 looks good. :+1:
Sam Roberts
@SamRoberts
Apr 02 2015 01:09
alright, responded to all comments except the possibility of empty lines at end of file
Sam Roberts
@SamRoberts
Apr 02 2015 01:22
@rowandavies I'm just going to deal with the empty lines issue now, so I don't have to revisit it later.
Sam Roberts
@SamRoberts
Apr 02 2015 01:30
ok, done
Sam Roberts
@SamRoberts
Apr 02 2015 01:51
travis is really flaky at the moment :frowning:
Rowan Davies
@rowandavies
Apr 02 2015 02:26
@SamRoberts Sorry - I was running a course session. The blank line issue as someone explained it (I’d have to think who, wish that discussion was via the github issue) was more like “after the trailer line there could be rubbish lines that don’t fit the format for a trailer line or data line or header line.” At this point, I can’t claim to know for sure what’s likely in practice.
Gavin Whyte
@gavinwhyte
Apr 02 2015 02:44
@SamRoberts seems like today is a day off for build agents.
Rowan Davies
@rowandavies
Apr 02 2015 02:46
The Easter Thursday build-agent holiday?
Sam Roberts
@SamRoberts
Apr 02 2015 03:04
@rowandavies ok, well, my commit will ignore blank or whitespace lines following the trailer line, but that's it
@gavinwhyte so no timeline for the build agents working again?
Gavin Whyte
@gavinwhyte
Apr 02 2015 03:13
I am currently on top of the case, and they are struggling with the fix. I am awaiting there response.
Sam Roberts
@SamRoberts
Apr 02 2015 03:13
ok
Stephan Hoermann
@stephanh
Apr 02 2015 03:15
@gavinwhyte you are dealing with the travis build agents or teamcity build agents?
Mithun Antony
@maxmithun
Apr 02 2015 03:41
@stephanh I need to transform from a thrift say Customer to thrift Account and my Account thrift adding extra field date which is not related to any fields in the Customer
Gavin Whyte
@gavinwhyte
Apr 02 2015 03:41
@stephanh teamcity only
if you like I can take on Travis, but if you kind you wont offer it to me. :)
Mithun Antony
@maxmithun
Apr 02 2015 03:42
Macros.mkTransform[Customer, Account]( ('id, (c: Customer) => c.acct), (‘date, (c: Customer) => date.toString) )
Stephan Hoermann
@stephanh
Apr 02 2015 03:58
@maxmithun general support questions should be raised in OmniaDatahub. The Maestro channel is here to discuss the development of Maestro itself.
In this case you already got the answer. Just because you have a function that takes in a customer doesn't mean you have to use it. All that matters is the output your function produces.
Mithun Antony
@maxmithun
Apr 02 2015 04:02
ok thanks @stephanh
Stephan Hoermann
@stephanh
Apr 02 2015 04:02
Does that answer your question/help?
Rakhesh Rajendran Nair
@rakheshrnair
Apr 02 2015 04:03
Getting the unresolved dependency error in Team City.
[14:47:44][Step 2/5] [info] Resolving org.fusesource.jansi#jansi;1.4 ...
[14:47:45][Step 2/5] [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
[14:47:45][Step 2/5] [warn]     ::          UNRESOLVED DEPENDENCIES         ::
[14:47:45][Step 2/5] [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
[14:47:45][Step 2/5] [warn]     :: org.apache.avro#avro-mapred;1.7.6-cdh5.2.4: not found
[14:47:45][Step 2/5] [warn]     ::::::::::::::::::::::::::::::::::::::::::::::
[14:47:45][Step 2/5] [warn] 
[14:47:45][Step 2/5] [warn]     Note: Unresolved dependencies path:
[14:47:45][Step 2/5] [warn]         org.apache.avro:avro-mapred:1.7.6-cdh5.2.4
[14:47:45][Step 2/5] [warn]           +- org.apache.sqoop:sqoop:1.4.5-cdh5.2.4
[14:47:45][Step 2/5] [warn]           +- au.com.cba.omnia:parlour_2.10:1.8.1-20150326035955-18bc8d9
Stephan Hoermann
@stephanh
Apr 02 2015 04:03
@rakheshrnair the channel for support is OmniaDatahub. This is the channel to discuss maestro development.
@rakheshrnair @gavinwhyte is on point to address this problem
Rakhesh Rajendran Nair
@rakheshrnair
Apr 02 2015 04:05
ok
Mithun Antony
@maxmithun
Apr 02 2015 04:09
@stephanh yes
Gavin Whyte
@gavinwhyte
Apr 02 2015 04:13
I am currently escalating this issue, get back to you shortly
Stephan Hoermann
@stephanh
Apr 02 2015 04:33
@SamRoberts @vineethvarghese @rowandavies Thank you for finishing off #351!
Stephan Hoermann
@stephanh
Apr 02 2015 04:40
Next time we create a new repo we should just merge all the boiler plate/initial stuff into master then just do the PR with the files that actually matter.
Sam Roberts
@SamRoberts
Apr 02 2015 04:40
:+1:
Vineeth Varghese
@vineethvarghese
Apr 02 2015 04:40
Ok
Rowan Davies
@rowandavies
Apr 02 2015 04:41
Nice idea!
Rowan Davies
@rowandavies
Apr 02 2015 05:16
Just pushed a tidy version of RichExecution that refactors by expressing Execution relative to ResultantMonad: CommBank/maestro@0c17074