Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Kirill Simonov
    @xitology
    wrong channel?
    Clark C. Evans
    @clarkevans
    Hello! So, just now we've finished a real-world application of DataKnots to the OHDSI project. With their sample medicare SynPUF data, I've replicated a cohort query that returns patients having an acute heart attack, Acute myocardial infarction events. This cohort query returns what their generated SQL produces. Anyway, it required only a small domain specific query language (DSQL) OHDSI specific copybook, of reusable definitions. Anyway, this is quite encouraging.
    This uses Kyrylo's new SQL generator against an PostgreSQL datasource. It's very inefficient currently, but we're focusing on being correct.
    clarkevans @clarkevans cheers.
    TimoLarson
    @TimoLarson
    A great milestone :)
    Oleksiy Golovko
    @zindel
    Super!
    Clark C. Evans
    @clarkevans
    Hello. So, I spoke at JuliaCon this afternoon. I was pretty tired & heavily medicated.
    Thanks for all of the support from colleagues here.
    Oleksiy Golovko
    @zindel
    @clarkevans Great talk!
    Andrey Popp
    @andreypopp
    Great talk! Watched it end to end.
    Clark C. Evans
    @clarkevans
    Hi. So, today I gave a talk in the OHDSI community, the slides are at... https://querycombinators.org/dist/ohdsi-dataknots-20190730.pdf
    This talk was a essentially a walk-though of our work converting one of their cohort queries, https://github.com/rbt-lang/SynPUF-HCFU/blob/master/cohorts/1770675.md
    Anyway, I'm busy this week working on a grant application for https://chanzuckerberg.com/rfa/essential-open-source-software-for-science/
    Here's to hoping someone over there thinks we're essential. ;)
    Clark C. Evans
    @clarkevans
    OK. The grant application to CZI was submitted. Let's cross some fingers we might have a years of focused effort.
    Thank everyone here for their support.
    Clark C. Evans
    @clarkevans
    Hello. Although there's been no development activity, I've converted the OHDSI talks into a paper and yesterday submitted it to AMIA's Informatics Symposium
    Clark C. Evans
    @clarkevans
    Next week I'm off on a vacation. The following week I hope to work on an NIH SBIR to apply combinators to FHIR. That might be harder deadline to meet though, as letters are needed soon and there's a shit ton of administrative work involved, so I may abandon this goal. Even so, we still need to get funding ;(
    Clark C. Evans
    @clarkevans
    Hello. I just wanted to say that a NIH SBIR grant proposal went out today. Thanks for those who helped.
    The week of the 15th, I'm down at the OHDSI conference where we'll be giving a poster on the use of Query Combinators for their cohort queries.
    I think in another week or so, I'll be done with the paper & conference & grant-writing and be able to get back to documentation and sort.
    Robert Schwarz
    @rschwarz
    :+1:
    Clark C. Evans
    @clarkevans
    Poster for Monday @ OHDSI is up.
    Clark C. Evans
    @clarkevans
    Hi. So, I just got back from OHDSI conference. The poster session was interesting, one of the first times I've had a chance to engage with potential users of DataKnots.
    One of the things I've learned is that the description of DataKnots as a combinator langauge, ie, where combinators are functions taking query functions as arguments and building a query function, works quite well.
    Second, I've realized that navigation + keep is probably analogous to table join in SQL. That is, the principle things you do are navigate down the tree doing things, and keeping things you've made along the way.
    So, a better operational description of DAtaKnots aong these lines would help us.
    Anyway. We may have a few more than join us. I met some very lovely people at the conference.
    At this time, I've got one more conference in October, and then the next one will probably be PgCon in March.
    So... what we're going to do is buckle down and get SQL generation working fluidly.
    clarkevans @clarkevans cheers.
    Robert Schwarz
    @rschwarz
    :clap:
    Clark C. Evans
    @clarkevans
    I expect to make a big splash at PgCon. Lots of people were supportive of HTSQL, but it was GPL licensed and had a unspecified model /w quirks. DataKnots fixes both of those issues. I expect that with solid SQL generation of complex queries, we'll have something that will break though. Further, at that time, I hope we could become the defacto SQL library for Julia. Of course, we'll work with other data sources, but solid SQL generation will provide the bridge needed for broad adoption.
    Anyway. Thank you all for your support & encouragement.
    Robert Schwarz
    @rschwarz
    That is for Postgres?
    Clark C. Evans
    @clarkevans
    So, https://github.com/rbt-lang/DataKnots4Postgres.jl has the PostgreSQl adapter.
    The adapter is non-performant.
    The next step is to develop an "optimization" system for DataKnots. This will then be used to "push-down" queries to SQL.
    Robert Schwarz
    @rschwarz
    Ah, yes, I meant PgCon :-)
    Clark C. Evans
    @clarkevans
    https://www.pgcon.org/ is where all the old timers go.
    I'm a fixture there, although I've been absent for a few years.
    But, yea, PgCon is the main conference where the core developers & contracting companies meet up annually.
    There are more commercial ones in the U.S. -- but this one in Ottowa, following BSDCAN has been around for 15+ years.
    I hope this helps.
    David L Denton
    @davidldenton
    Just introducing myself. I met Clark at the OHDSI conf and he got my attention very quickly. This is a fascinating and important project. Still new to Julia myself, but once my skills are up to snuff, I hope to contribute. Keep up the great work.
    Clark C. Evans
    @clarkevans
    Welcome!