Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Daniel Kumor
    @dkumor
    great! I'm planning to add sleep as android integration also
    Patrick Grosslicht
    @pgrosslicht
    you'd add that to android app, right?
    Daniel Kumor
    @dkumor
    I should have the new skeleton of gathering code pretty much ready by the end of this weekend.
    yes
    ATM ConnectorDB itself doesn't have a plugin system. I am thinking about it, since integration with fitbit or withings would be very useful, but I don't yet know how to do it right.
    Patrick Grosslicht
    @pgrosslicht
    I also plan on porting the python API to java since that's what I use most often
    I probably would just have built a layer between connectordb and moves, that connects to moves, formats it for connectordb and puts it there
    Daniel Kumor
    @dkumor
    yes, currently I am gathering data from external services as cron jobs that connect to their APIs and insert to ConnectorDB
    As a side note, the current Java API was made in 2 hours just to be enough for use in android.
    I don't use Java often, so if you're willing to take over the java API, I'll give you push access
    Patrick Grosslicht
    @pgrosslicht
    yeah, I can do that. I will have to get acquainted with the API before I'm going to start working on it though
    Daniel Kumor
    @dkumor
    The REST API is documented here: https://connectordb.io/docs/restapi.html
    I'll give you access now, so you have free reign whenever you feel like it
    Patrick Grosslicht
    @pgrosslicht
    awesome, thanks
    I'll probably gonna orient myself to the python api
    Daniel Kumor
    @dkumor
    yes, the Python API is the main one I personally support
    Nilesh
    @nileshtrivedi
    Downloading Mac Desktop version leads this page with "File Not Found" error: https://dkumor.keybase.pub/connectordb/connectordb_desktop_0.3.0-git.1145_darwin_amd64.tar.gz?dl=1
    Daniel Kumor
    @dkumor
    I am aware of this issue. The automated build scripts run on linux, and there are no cross-compilers for mac. Therefore the mac development versions sometimes get skipped (during pre-release). I will fix this momentarily.
    Daniel Kumor
    @dkumor
    The mac version should now download. Be aware that the mac version is very much a work in progress - it only recently started working, and there are several bugs which will be fixed by release.
    Nilesh
    @nileshtrivedi
    @dkumor Thanks! Which version is the best? Linux server?
    Daniel Kumor
    @dkumor
    Yes - linux server is by far most tested, since that is the one I use myself
    However, CI tests pass on both mac and windows also, so most expected issues in the pre-release are with integration rather than the server (ie: currently no installer on mac, there might be configuration issues that disallow connecting from outside localhost, etc).
    Erik Bjäreholt
    @ErikBjare
    Hi there @dkumor, thanks for the email reply.
    Figured this would be a better place for communication
    Created a gitter room for ActivityWatch btw: https://gitter.im/ActivityWatch/activitywatch
    Daniel Kumor
    @dkumor
    Alright, let's continue in the ActivityWatch gitter
    I will be able to chat later today (after work)
    Erik Bjäreholt
    @ErikBjare
    Btw, what is your plans? When do you aim for a stable/marketed release?
    Daniel Kumor
    @dkumor
    The data-gathering and visualization capabilities of ConnectorDB are pretty much ready for release. All that is left is fairly extensive examples and documentation, and 0.3.0 will be released. I have been testing the newest version for the past couple months, and have not found any serious bugs yet.
    I have actually found that the data itself is not enough to gain the insight I was hoping for, so my focus has shifted to the ML portion of the project - a completely separate AI which performs analysis of the data.
    Daniel Kumor
    @dkumor
    This means that the visualization/data gathering are now secondary concerns - they work well enough for now to bootstrap the ML algorithms, and with 2 years of personal data, I hope the uniqueness of my training set combined with some clever predictive capabilities will lead to interesting results.
    Erik Bjäreholt
    @ErikBjare
    What kind of insight are you after? Which types of ML are of interest?
    Nilesh
    @nileshtrivedi

    How are events stored in Postgresql? I'm wondering if it would be possible to simply run Metabase on top of the database for the visualization / reports / alerts.

    Also, the ML bits too can be done in DB itself using Apache Madlib.

    Daniel Kumor
    @dkumor
    Unfortunately, I got carried away with premature optimization, so events are stored in msgpacked batches, about 250 events per batch.
    This makes the database incredibly fast... But makes everything else very difficult
    Nilesh
    @nileshtrivedi
    Where in the code can I see the database schema?
    I want to know what an "event" is defined as. Is it similar to events in Google Analytics?
    Or is it more like Google Fit's metrics?
    Daniel Kumor
    @dkumor
    Currently travelling, will be able to respond in about an hour
    Nilesh
    @nileshtrivedi
    With a simpler schema, Metabase/Tableau can give free visualization/reports/alerts.
    Daniel Kumor
    @dkumor
    Understood - right now ConnectorDB does visualization of many data types itself. Unfortunately, replacing the backend would be quite an endeavour, so for now it is stuck for better or worse.
    Right now the easiest way to import the data into another database is to export from ConnectorDB using the python interface and reimport using the database of choice.
    Nilesh
    @nileshtrivedi
    @dkumor What's the future of ConnectorDB project? The website is still up but the last commit was 8 months ago.
    Daniel Kumor
    @dkumor
    My phd research has taken precedence recently, and I have not had time to really dig into the project. The future of ConnectorDB is dependent on whether I will be able to extract useful insights out of the data I have gathered over the past 2 years. So far, basic analysis has not turned up any life-altering insights. I have a couple ideas on types of analysis to try, but it might take a while for me to find the time to actually do it!
    Nilesh
    @nileshtrivedi
    @dkumor Got it. How about decoupling the development of tracking apps and the backend by defining the event API as a protocol? That should help bring more devs by enabling more use-cases for the tracking apps?
    Daniel Kumor
    @dkumor
    Could you clarify what you mean by that? Are you saying to define the elements of the REST API used by the tracking apps so that others can use their own servers to gather the data, rather than connectordb itself?
    Nilesh
    @nileshtrivedi
    Yes. And vice-versa: Use connector-db's backend with custom clients. When the protocol is defined independently of software implementations, both client and server components can innovate and evolve faster.
    Daniel Kumor
    @dkumor
    ConnectorDB's backend can already be used with custom clients - the API is documented as https://connectordb.io/docs/restapi.html
    In particular, there is a full-featured python client at https://github.com/connectordb/connectordb-python