by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Oct 27 2015 09:05
    xtordoir closed #37
  • Oct 27 2015 09:05
    xtordoir opened #37
  • Oct 19 2015 11:16

    cfregly on master

    snipped dependencies on all thi… (compare)

  • Aug 16 2015 07:08

    velvia on master

    Move the USB instructions to th… (compare)

  • Aug 16 2015 01:13

    retroryan on master

    updating cassandra exercises Merge pull request #36 from ret… (compare)

  • Aug 16 2015 01:13
    retroryan closed #36
  • Aug 16 2015 01:13
    retroryan opened #36
  • Aug 16 2015 00:57

    retroryan on master

    updating cassandra exercises Merge pull request #35 from ret… (compare)

  • Aug 16 2015 00:57
    retroryan closed #35
  • Aug 16 2015 00:57
    retroryan opened #35
  • Aug 15 2015 22:59

    cfregly on master

    changed wording a bit (compare)

  • Aug 15 2015 20:51

    cfregly on master

    cleaned up README (compare)

  • Aug 15 2015 20:50

    cfregly on master

    cleaned up README (compare)

  • Aug 15 2015 20:46

    cfregly on master

    removed contents of readme in f… (compare)

  • Aug 15 2015 20:36

    cfregly on master

    stopping zookeeper (compare)

  • Aug 15 2015 20:02

    cfregly on master

    updated scripts (compare)

  • Aug 15 2015 19:15

    cfregly on master

    changed everything to 0.13.8 (compare)

  • Aug 15 2015 18:59

    cfregly on master

    added back SPARK_VERSION to Doc… (compare)

  • Aug 15 2015 18:39

    cfregly on master

    fixed job server, cleaned up ex… (compare)

  • Aug 15 2015 18:22

    cfregly on master

    fixed job server build by set L… (compare)

Chris Fregly
@cfregly
rebuilding final image
Chris Fregly
@cfregly
just pushed the docker image
testing locally
i'll also create an AMI as well as a bythebay.tar that will be used on the USBs
services seem to startup ok
testing services
Chris Fregly
@cfregly
This message was deleted
ok
docker image has been fully tested end to end
the bythebay-pipeline-docker-image.tar file is sitting in ~/pipeline of the EC2 instance that i sent to you guys yesterday
here's the remaining steps:
1) build the USB's using this tar file (it'll need to be scp'd down using the bythebay.pem that i sent yseterday)
2) go through the bythebay wiki and make sure the steps make sense
Chris Fregly
@cfregly
there are still refs to boot2docker in there, so those need to be removed
i moved the main README.md stuff into the Wiki and simplified the main README.md
i did not, however, touch the README.md within the usbstick/ dir because i'm not familiar with the new process and wasn't comfy modifying anything or merging into the wiki
a cleaner way, of course, would be to merge it with the wiki, but that's just my opinion
at this point, i need to focus exclusively on my flux stuff for my talk
for my talk on Monday, that is
please call me if you need anything
@velvia i assume you'll be covering the end-to-end architecture overview, correct? i still haven't seen the doc, but am trusting you've got that covered
@andypetrella i'll likely lean on you for more Spark stuff than originally intended. i've got some good images and such that i can share
i'll try to sync up w/ you guys later tonight, but not sure i'll be there for dinner given that i lost the last 4-5 hrs of my day recovering things from last night
@velvia please update the arch overview diagram and update the wiki - not just your slides
if we have 0 slides and all wiki,that would be just fine. slides are to augment, but remember the little people who can't afford to be in the class! :)
Andy Petrella
@andypetrella
@cfregly let's talk about that this evening, I'm used to write slides until jumping on the floor :-)
Chris Fregly
@cfregly
haha
@andypetrella right and to be clear - i have slides for intro spark stuff (rdd's, pipeline execution, etc)
i'll handle all that shit
you shouldn't have to do any prep beyond the notebooks that you've already done
i just mean that i'll be going quickly thru the intro stuff and then i want to get right into code (your notebooks)
so let's say 20 mins intro to spark
and spark streaming
then 20 mins of code
then 20 mins of either job server or ryan's code or whatever
we'll be OK
Andy Petrella
@andypetrella
I'm revamping my example on Variance Bias using Figaro too, which uses MLLib LM too
Jesse Anderson
@eljefe6a
@cfregly latest version working. about to get on plane for SFO and won't be able to go through wiki. this plane doesn't have wifi.
Chris Fregly
@cfregly
@eljefe6a ok no worries. i went thru it mostly and got all the scripts correct
the boot2docker stuff is a outdated, but hoping @velvia and @benoahriz or others can fix
i won't have time tonight, unfortunately
Andy Petrella
@andypetrella
@eljefe6a if you don't mind I put some syntax highlighting on the code snippets
choipoby
@choipoby
Where can I get files that is used for mesos/marathon demo? the tweet demo?
choipoby
@choipoby
thanks!
chokha
@chokha
np
Jonathan Ruttenberg
@ruttenberg
Anybody know the link for the Cassandra slides?
Bhupinder Gulati
@bgulati
Pipeline-Cassandra-Technical-Overview.pdf
The Cassandra slides ^
Jonathan Ruttenberg
@ruttenberg
Thanks!