Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Adrian Petrescu
    @apetresc
    Testing the new room
    Alejandro Guerrero Gonzalez
    @aggFTW
    hello @apetresc!! :)
    Adrian Petrescu
    @apetresc
    Hey @aggFTW :)
    You found the channel! I just set it up a few days ago
    Just saw your e-mail, kicked off the job again
    Okay beautiful, that worked
    I'll do one last round of manual testing from test.pypi.org and push to release tonight
    I'm actually in a hotel room for Microsoft Ignite as we speak :P
    Alejandro Guerrero Gonzalez
    @aggFTW
    haha nice!
    i did find the channel through the commit
    good luck with the conference!
    let me know if you need more help!
    abhisam
    @abhisam
    Hi all
    Did anyone use spark magic with Aws Emr ?
    Adrian Petrescu
    @apetresc
    Hey @abhisam - yes, I do that frequently :)
    Adrian Petrescu
    @apetresc
    Are you encountering any issues?
    abhisam
    @abhisam
    Yes
    Are you able to plot any graphs in a Emr with jupyerhub application ?
    I mean using Matplotlib package ...
    abhisam
    @abhisam
    @apetresc
    etheleon
    @etheleon
    Hi guys
    Joaquín Chemile
    @jchemile
    Hello Guys!! Do you have any resourse where i can find the way to import my scala local functions to the Notebook (Something like when i don "Pip install ." whith Python) - Thanks!
    Javier Bianco
    @JaviBml
    Hi guys, do you know how can I select a different sparkmagic "config.json" file when a kernel is starting? I've tried modifying the "kernel.json" file adding two variables into "env" secction: "env":{"SPARKMAGIC_CONF_DIR":"/home/basic/.sparkmagic", "SPARKMAGIC_CONF_FILE":"config02.json"} but didnt work. Thanks!
    John Pugliesi
    @jpugliesi

    Hello - I'm using sparkmagic to execute long-running spark jobs, and running into an issue where the sparkmagic livy session dies if the submitted spark job runs longer than the configured livy.server.session.timeout. The error manifests as the usual:

    An error was encountered:
    Invalid status code '404' from http://my-livy-server:8998/sessions/38 with error payload: {"msg":"Session '38' not found."}

    Does the sparkmagic session heartbeat thread not keep the session alive if a cell runs longer than the livy session's timeout?

    Appreciate the help

    Itamar Turner-Trauring
    @itamarst
    woah I did not realize this existed
    I guess it's rarely used so maybe that's OK
    but in general—if there's no one here and you have a problem, please file an issue on GitHub
    NawabiCoder
    @nawabiCoder_twitter
    Hey Team, I am trying to figure out a way in sparkmagic to supply additional jars after session creation.