These are chat archives for connectordb/connectordb

1st
Aug 2017
Nilesh Trivedi
@nileshtrivedi
Aug 01 2017 20:01

How are events stored in Postgresql? I'm wondering if it would be possible to simply run Metabase on top of the database for the visualization / reports / alerts.

Also, the ML bits too can be done in DB itself using Apache Madlib.

Daniel Kumor
@dkumor
Aug 01 2017 20:12
Unfortunately, I got carried away with premature optimization, so events are stored in msgpacked batches, about 250 events per batch.
This makes the database incredibly fast... But makes everything else very difficult
Nilesh Trivedi
@nileshtrivedi
Aug 01 2017 20:35
Where in the code can I see the database schema?
I want to know what an "event" is defined as. Is it similar to events in Google Analytics?
Or is it more like Google Fit's metrics?
Daniel Kumor
@dkumor
Aug 01 2017 20:38
Currently travelling, will be able to respond in about an hour
Nilesh Trivedi
@nileshtrivedi
Aug 01 2017 21:02
With a simpler schema, Metabase/Tableau can give free visualization/reports/alerts.
Daniel Kumor
@dkumor
Aug 01 2017 22:36
Understood - right now ConnectorDB does visualization of many data types itself. Unfortunately, replacing the backend would be quite an endeavour, so for now it is stuck for better or worse.
Right now the easiest way to import the data into another database is to export from ConnectorDB using the python interface and reimport using the database of choice.