by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    ericjeangirard
    @ericjeangirard
    Hi ! The doc says the ovh-spark-submit binary is there : https://repository.dataconvergence.ovh.com/repository/binary/ovh-spark-submit/mac/ovh-spark-submit
    But i get an error 500 page ?
    baaastijn
    @baaastijn
    Hello Eric !
    thanks for reaching us
    allow me to explain, with some context :)
    Few months ago we started working on a lab called Spark as a Service. We deployed Spark clusters that were up and running h24, and with a CLI made by OVH
    but.. it was not exactly what our customers were looking for
    we refactored everything, to propose today another approach :
    1/ you submit job via control panel or API
    2/ we deploy Spark cluster in few second, just for you and this specific job, and you pay what you consume
    in short, it’s available in control panel and API already, and it’s free for now !
    i’m redacting various tutorials that i can share with you if needed
    cc @ericjeangirard
    ericjeangirard
    @ericjeangirard
    Thanks for the reply ! I've tested with control panel indeed, but i didn't find examples to submit a job with the API
    baaastijn
    @baaastijn
    good
    yes i’m redacting it too
    were you able to launch it correctly via control panel ?
    if you have ideas of issues, just telle us here, the whole dev team is with us :)
    ericjeangirard
    @ericjeangirard
    well, it did launch, but it failed, obviously ;) i tried to see the logs, but they don't seem to be downloaded to object storage
    baaastijn
    @baaastijn
    usually when a job fail without logs is due to environment.yml not ok
    if it’s not sensitive data don’t hesitita to share it here
    of via email if needed
    Or*
    ericjeangirard
    @ericjeangirard
    yes, maybe better by mail, where can i reach you ?
    baaastijn
    @baaastijn
    i’ve sent my mail in private in Gitter :)
    ericjeangirard
    @ericjeangirard
    thanks!