Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    AdamPitt
    @AdamPitt
    :point_up: February 26, 2020 4:53 PM
    I managed to get the plot working by ensuring I had a "string" type in my Dataframe. However I couldn't do a simple x/y scatterplot for a Dataframe of (Double,Double)
    I can see the plot rendered in the plot UI however if I click "source" and copy/paste the Vega spec back into a Vega cell it doesn't render when in the notebook. It doesn't error and there is nothing in the console
    AdamPitt
    @AdamPitt
    Found how it works if instead you click "save" instead of trying to copy/paste the source spec then it works a charm!
    jeremyrsmith
    @jeremyrsmith
    @JD557 it uses NIO so I'm not sure if that's covered by native or js
    João Costa
    @JD557
    just tested it and I think it actually compiled :O ... I'm expecting some error down the line, though...
    jeremyrsmith
    @jeremyrsmith
    which did you test? native or JS?
    oh, looks like scala-native does have an NIO implementation. Dang, that's a lot of work, kudos to them :grinning:
    João Costa
    @JD557
    native, but it seems that zio doesn't work that well yet... I bumped into some weird issues, but I might try again later
    jeremyrsmith
    @jeremyrsmith
    It could also be that uzhttp doesn't work that well :laughing: You Probably Shouldn't Use It™
    Anton Kulaga
    @antonkulaga
    Guys, does anybody succeffully use polynote with spark3?
    For me after switching reading csv-es does not work a all :(
    Anton Kulaga
    @antonkulaga

    A simple code like:

    val df = spark.read.format("csv").option("header", true).option("sep", "\t").load("/data/ensembl/99/ensembl_anage_vertebrates.tsv")
    df.printSchema()

    runs for ages in polynote for spark 3

    Alvaro Carrasco
    @alvaroc1

    getting this error when adding a dependency: https://mvnrepository.com/artifact/diff_match_patch/diff_match_patch/current

    Illegal character in scheme name at index 4: diff_match_patch:diff_match_patch:current

    is the dependency parser too strict? is there a workaround?

    1 reply
    sachdevasahil7
    @sachdevasahil7
    Hello @all,
    i want to know is there any documentation to setup polynote in Intellij .
    i tired to run Polynote from intellij and worked pretty well , fronted is working but when i start kernel i got an exception
    | java.io.IOException: Cannot run program "spark-submit": error=2, No such file or directory
    please someone help me how can i resolve this
    image.png
    João Costa
    @JD557
    do you have spark installed?
    sachdevasahil7
    @sachdevasahil7
    image.png

    yes

    do you have spark installed?

    yes ..!! I am not able to start a normal kernel without spark configuration got an exception

    toxicafunk
    @toxicafunk
    looks like a version issue from here
    jeremyrsmith
    @jeremyrsmith
    @sachdevasahil7 this particular issue is from the IntelliJ run configuration. You have to open the run configuration and make sure Include dependencies with "provided" scope is checked.
    apologies, I hope to have actual docs about this kind of stuff in the not-too-distant future
    Moritz Baumotte
    @moritzbaumotte

    Just quoting this from your page - "Polynote is currently only tested on Linux and MacOS, using the Chrome browser as a client. We hope to be testing other platforms and browsers soon. Feel free to try it on your platform, and be sure to let us know about any issues you encounter by filing a bug report." When should Windows guys expect support for our platform? Don't get us sidelined. This looks more promising than what we should miss, you know?

    In case you haven't got it running yet, I created a script to run polynote on windows (using docker). It run's the currently latest polynote version 0.3.11 but I'll soon update it to automatically pull the newest version (notebooks are persisted in a mounted folder). Feel free to check it out.

    https://github.com/moritzbaumotte/polynote-windows-inofficial

    jonathanindig
    @jonathanindig
    Hi @moritzbaumotte thanks for your interest in Polynote! I’m curious, what prevents users from using the official polynote docker images (https://hub.docker.com/r/polynote/polynote) on Windows?
    jonathanindig
    @jonathanindig
    By the way, it does seem like a decent number of people have been successful running Polynote on Windows with Windows System for Linux: polynote/polynote#671
    It looks like our documentation was out of date on the website, because it was supposed to say that. I’ll fix the doc update job and hopefully reduce confusion here.
    Moritz Baumotte
    @moritzbaumotte
    Hi @jonathanindig thanks for providing it! I though about the Windows subsystem for Linux as well but unfortunately it is blocked in my company via the Active Directory.
    As for the official docker image, you can run it properly on Windows, Polynote starts correctly inside the container but you can't access it from the Windows host (you'll get some connection refused or connection timeout error). To access it from Windows Polynote would need to socket bind to 0.0.0.0 inside the container rather than 127.0.0.1 (which it is per default I belief). That's what this tiny config.yml is for in my repository.
    Moritz Baumotte
    @moritzbaumotte
    I'm not a networking guy though, I can't really explain why 127.0.0.1 doesn't work but I experienced the same issue before with python web servers.
    jonathanindig
    @jonathanindig
    That’s expected with Docker. Here’s our official docker documentation: https://github.com/polynote/polynote/tree/master/docker#official-docker-images
    For security reasons the official Docker distribution needs you to provide your own configuration. This is by design; please see https://github.com/polynote/polynote/issues/666#issuecomment-555212474 for more about our rationale.
    Moritz Baumotte
    @moritzbaumotte
    Okay, then I can't explain it. I basically took an older approach on Dockerizing Polynote for Windows and completed it fixing any bug I could find until it worked.
    Btw, I've updated my repo that it automatically uses the newest Polynote version - not a pretty solution but good enough to make it run. ;)
    João Costa
    @JD557
    Not sure if this is possible or easy, but has anyone got polynote to run inside of docker with cuda working?
    I think the base image would have to be based on something like nvidia/cuda:9.0-base :(
    jonathanindig
    @jonathanindig
    Unless there’s something about those cuda images I’m not familiar with, there shouldn’t be anything inherently difficult about getting Polynote onto those images, at least from Docker’s POV
    Here’s the Dockerfile Polynote uses. You should be able to change the base image to whatever you like, all you'd need to do is make sure to install java
    (now, getting the python running inside of Polynote to properly interface with cuda… no idea if that would work. )
    João Costa
    @JD557
    I was looking into that, I might try to build a docker image later
    the nvidia GPU is not on my main dev machine, so this is quite cumbersome to try... maybe I'll check that during the weekend :sweat_smile:
    jonathanindig
    @jonathanindig
    good luck :) if it works, feel free to contribute a Dockerfile
    raproth
    @raproth
    Currently python stopped working in polynote, I get Uncaught exception: <class 'SyntaxError'>: future feature annotations is not defined (jep.JepException) any idea whats wrong? Running Python 3.6.10 on Linux. Do I need Python > = 3.7?
    Clay Lambert
    @claylambert33_twitter
    @raproth it has been my experienxe that 3.7 works better overall. I don’t know if that will resolve your jep exception per se.
    jonathanindig
    @jonathanindig
    @raproth This is due to a recent change in the new release: polynote/polynote#951 Didn’t realize it wouldn’t work in 3.6 but we’re mainly targeting 3.7. Any particular reason you’re using 3.6?
    jeremyrsmith
    @jeremyrsmith
    heh, python is so hard to support with one interpreter, because there's no union of "all of python" even within 3.x. Minor versions have removed stuff and added other stuff, you can't capture that in a union
    I imagine we'll run into the same thing when we start worrying about Scala 3... :grimacing:
    Should there be a Python < 3.7 interpreter and a Python >= 3.7 interpreter? I don't know really... I'd prefer not, but this is the kind of thing that may become necessary :frowning:
    João Costa
    @JD557
    FWIW, according to https://endoflife.date/python, python 3.6 support ends in 1 year and 3 months
    I would say that it might not be worth it to add that support just for one year, but OTOH, all surveys that I can find say that 3.6 is the most used version :grimacing:
    raproth
    @raproth
    @jonathanindig no particular reason, currently python 3.6.10 is installed on our server and I do not have the permissions to change that myself. But don't worry, at least I know what to do
    Lanking
    @lanking520

    Hi all, I am new to PolyNote, currently trying to install it on my mac (Mac OS Catalina) and failed with Python 3.7 virtualenv:

        ld: library not found for -lpython3.7m
        clang: error: linker command failed with exit code 1 (use -v to see invocation)
        error: command 'xcrun' failed with exit status 1

    It seemed to be an issue with jep, did anyone saw this before?

    jonathanindig
    @jonathanindig
    @lanking520 from a quick Google search, it looks like you need to install Xcode tools: https://ma.ttias.be/mac-os-xcrun-error-invalid-active-developer-path-missing-xcrun/