These are chat archives for frictionlessdata/chat

21st
Oct 2016
Jaakko Korhonen
@jaakkokorhonen
Oct 21 2016 19:43
I’m doing a (mydata) (health) project where we want to publish a table of health measurement data to the user, and give possibility to download the data as csv, and upload a updated csv. Any ideas on what libraries or standards we should pursue to use?
Daniel Fowler
@danfowler
Oct 21 2016 19:43

@rgrp et al. you might be interested in visiting SmartCSV if you want a desktop based CSV editor/validator (along the lines of Comma Chameleon) but written in Java. The author has dropped his bespoke tabular schema format in favor of JSON Table Schema.

http://www.billmann.de/2016/10/19/smartcsv-fx-version-0-9/

@jaakkokorhonen tell me more
Jaakko Korhonen
@jaakkokorhonen
Oct 21 2016 19:45
well it’s a health self-monitoring self-diagnostic app
a project funded by the government, so we have 2M users in the municipalities participating in funding the project
and quantified self -people are asking for a generic data import/export functionality to explore innovative use of their data
Rufus Pollock
@rufuspollock
Oct 21 2016 19:55
@danfowler thanks for the context - that’s great to know :-)
Evstifeev Roman
@Fak3
Oct 21 2016 20:27
@jaakkokorhonen for the data download tabular datapackage standard may be a good fit. But for the ability to upload the data back - highly dependent on how users will actually fiddle with data? Can you expand the usecase?
Jaakko Korhonen
@jaakkokorhonen
Oct 21 2016 20:28
well if they can download a csv, it’s not unreasonable to expect they can upload one, reusing the downloaded schema
Evstifeev Roman
@Fak3
Oct 21 2016 20:32
@jaakkokorhonen yes, the main concern is that any tool they will use to edit the data should honor the schema. And there will be a challenge to bridge with other tools that do want to use their own schema.
Jaakko Korhonen
@jaakkokorhonen
Oct 21 2016 20:33
indeed.
so a lot of people will be on excel unless we can provide a cool tabular editing app
Evstifeev Roman
@Fak3
Oct 21 2016 20:39
There might be some rdf vocabularies for the medical data your tool deals with. If you will find already standartized vocabs - you can try to use it too. But rdf, while purposed for standartization, will bring a lot of new challenges.
Daniel Fowler
@danfowler
Oct 21 2016 21:07
@jaakkokorhonen @Fak3 Comma Chameleon (http://comma-chameleon.io/) and SmartCSV.fx (https://github.com/frosch95/SmartCSV.fx) are both offline CSV editors that can read a JSON Table Schema to validate data before upload
Daniel Fowler
@danfowler
Oct 21 2016 21:49
@rgrp I haven’t pinged the wellcome trust yet. I don’t think we’re all the way there with this use case given lack of support here: frictionlessdata/specs#156
Daniel Fowler
@danfowler
Oct 21 2016 21:56
@rgrp I’ve been wanting to craft a guide that takes in some research data management guidelines embedded within to present to folks like Wellcome: frictionlessdata/project#306