Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Scott Hajek
    @scottcode
    ?
    Christopher Ostrouchov
    @costrouc
    Ahh so for example ops.Round does not behave as expected. I have marked that operation as unsupported but the Round tests still fail.
    Scott Hajek
    @scottcode
    Which test suite tests that?
    Christopher Ostrouchov
    @costrouc
    So I am guessing I need to track down the round tests and mark it as xfail for the sql server backend
    Okay here is a concrete example ibis/tests/all/test_string.py::test_string[MSSQL-contains] FAILED [ 54%]. ops.Contains is already marked as unsupported
    Scott Hajek
    @scottcode
    @costrouc You can add this kind of flag to the test:
    https://github.com/ibis-project/ibis/blob/3b134518550abcf9826481d09c35e75b46bcda4c/ibis/tests/all/test_join.py#L34
    @pytest.mark.skip_backends([Csv])
    Christopher Ostrouchov
    @costrouc
    Thanks will use that!
    Scott Hajek
    @scottcode
    Let me know if that works, cuz I'm curious to know
    Christopher Ostrouchov
    @costrouc

    Yes it worked for example in a parametrized test

            param(
            lambda t: t.string_col.contains('6'),
            lambda t: t.string_col.str.contains('6'),
            id='contains',
            marks=pytest.mark.xfail_backends((MSSQL,)),
        ),
        param(

    This marked this specific test for mssql as xfail

    Scott Hajek
    @scottcode
    Or if it's just for specific parameters of the test, looks like you can add a marks keyword to the param()
    Yep, that's what I was starting to think
    Cool, now I'll know how to deal with that, too
    Christopher Ostrouchov
    @costrouc
    At the moment just trying to get the PR to pass. I was overly ambitious adding more and more operations to a new backend :smile:
    Ivan Ogasawara
    @xmnlab
    not sure if it is just for me .. but it seems ibis-dev/lobby gitter channel is using the new pandas logo ...
    Scott Hajek
    @scottcode
    @xmnlab Yep, looks that way to me too
    Ivan Ogasawara
    @xmnlab
    OT: hey everyone I hope everyone here is safe! #staysafe
    Tim Swast
    @tswast

    I noticed that the existing Hash ValueOp doesn't match the behavior of other databases like BigQuery (ibis-project/ibis#2310) or Postgres (https://ibis-project.org/docs/user_guide/extending_elementwise_expr.html)

    Hash takes any type and outputs an int64, whereas BigQuery and Postgres take string/bytes and output string/bytes

    I'm wondering if these should try to be reconciled? Or maybe we could add a HashBytes operator?

    Estíbaliz Parcero
    @esparig
    Hello everyone! I wanted to take a look to the project, and I'm trying to set up the dev environment, but apparently the "contribute webpage" is not updated (ci/requirements-dev-3.7-main.yml file doesn't exist) please can anyone give me some insight? thanks
    Tim Swast
    @tswast
    Requirements are now split by backend in https://github.com/ibis-project/ibis/tree/master/ci/deps
    Estíbaliz Parcero
    @esparig
    Thank you Tim
    Saurabh Jain
    @saurabhsjain
    Hi!
    Jesús Corrius
    @jcorrius
    hi there
    Marc Garcia
    @datapythonista
    Hi everybody, we're starting a remote Ibis sprint now, for the ones joining, this is the link to the call: https://meet.jit.si/ibis-sprint
    Marc Garcia
    @datapythonista
    PR with the new tutorials: ibis-project/ibis#2266
    Marc Garcia
    @datapythonista
    Slides on how to do a PR: https://docs.google.com/presentation/d/1rOSYXZPyMe9KXnbVK_xbJzw_-ijxd6bIxndmvPU6L2o/edit?usp=sharing
    Ariel Silvio Norberto RAMOS
    @asnramos
    Hello ..!! Im installing IBIS in my notebook
    Thanks @datapythonista ..!!!
    Hello @xmnlab ..!!!
    Matthew Turner
    @matthewmturner
    hi all, im working on ibis-project/ibis#2238 (configuring pep8speaks for line length). its unclear to me if its a config issue though since it looks like pep8speaks incorrectly labeled a short line (<79 chars) as long. i also see in pyproject.toml that black is configured for line length of 79, which aligns to what pep8speaks is already checking for. any thoughts on whether this is an actual config issue or something else?
    Ariel Silvio Norberto RAMOS
    @asnramos
    pip install ibis-framework...!!! Its Ok..!!!
    @datapythonista , @xmnlab .-
    Marc Garcia
    @datapythonista
    Seems like we're using <79 chars everywhere, so I think that issue was opened by mistake
    9 replies
    Marc Garcia
    @datapythonista
    How are people at the sprint doing? We've got a problem in the CI caused by a dependency, there will be a build failing, even if your PR is correct
    Two builds actually
    Matthew Turner
    @matthewmturner
    working on the impala backend move, going ok so far. will have a couple questions shortly
    CameronHenshaw
    @CameronHenshaw
    My job called with some work for me, so I might have to wait to this weekend to do more :'(
    Marc Garcia
    @datapythonista
    No worries, you're always welcome
    Thanks for joining
    Matthew Turner
    @matthewmturner
    is it expected that the isort precommit hook would change setup.cfg (removing impala from isort known third parties)
    Marc Garcia
    @datapythonista
    Not sure, I don't use the precommit hook, but doesn't sound reasonable
    Marc Garcia
    @datapythonista
    @matthewmturner I reviewed your PR, I commented there why of this behaviour
    Matthew Turner
    @matthewmturner
    @datapythonista thanks! adding responses there
    Marc Garcia
    @datapythonista
    Thanks to everybody who participated in the sprint. Lots of great contributions, we have plenty of PRs ready to merge once the problem in the CI is fixed (we're almost there)
    Matthew Turner
    @matthewmturner
    thanks for your time and guidance! great experience.
    Edoardo Abati
    @EdAbati_gitlab
    Thank you @datapythonista for organising!
    Manik Kaushal
    @manikkaushal_gitlab
    Hi guyzz... Can anyone please help me in answering few questions on ibis performance??
    Daniel Kim
    @pybokeh
    Is there a way to access a table cell value? I am trying to parse the last name from a full name column containing string of the form: "last_name,first name" and so I have this code: associates['NAME'].mutate(LAST_NAME=associates['NAME'].split(',')[0]) But get no results since LAST_NAME column is of type ArrayColumn and so indexing does not apply. If I remove the [0] from the end of my split, I get a ArrayColumn, but there doesn't appear to be a way to access the scalar value or the cell value for each row in that column.
    Scott Hajek
    @scottcode
    @pybokeh I’m not sure about indexing into an ArrayColumn, but for your specific example sounds like re_extract might work:
    https://ibis-project.org/docs/generated/ibis.expr.api.StringValue.re_extract.html#ibis.expr.api.StringValue.re_extract
    Daniel Kim
    @pybokeh
    @scottcode That'll do even though I usually try to avoid regex since I often have to google or look-up the regex pattern. Thanks!